-- Logs begin at Tue 2021-08-24 02:03:35 UTC, end at Tue 2021-08-24 03:15:47 UTC. -- Aug 24 02:51:03.770882 dv-cinder-803748-8-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Aug 24 02:51:06.462424 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.common.config [-] Logging enabled! Aug 24 02:51:06.463018 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev555 Aug 24 02:51:06.463195 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=111166) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Aug 24 02:51:06.468301 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.common.config [-] Logging enabled! Aug 24 02:51:06.468301 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev555 Aug 24 02:51:06.468301 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=111166) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Aug 24 02:51:06.468301 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 02:51:06.468301 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 02:51:06.468689 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 02:51:06.468689 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 02:51:06.468883 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 02:51:06.469207 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.469506 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.469824 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.470051 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.470343 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.470632 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.470912 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.471199 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.471492 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.471770 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.472047 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.472328 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.472556 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.472837 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] config_source = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.473124 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.473409 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.473662 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] debug = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.473941 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.474359 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.475324 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.475610 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.475898 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.476176 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.476447 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.476725 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.477018 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.477338 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] host = dv-cinder-803748-8-iscsi {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.477637 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.477929 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.478214 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.478500 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.478776 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.479053 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.479338 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.479614 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] log_dir = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.479887 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] log_file = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.480162 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.480449 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.480735 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.481024 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.481250 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.481473 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.481803 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.482078 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.482353 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.482624 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.482971 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.483299 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.483623 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.483894 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.484187 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.484476 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.484763 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.485038 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.485317 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.485610 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.485887 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.486170 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.486441 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.486712 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.486984 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.487270 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.487540 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.487812 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.488113 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.488397 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.488678 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.488961 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.489233 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.489515 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.489810 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.490083 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] use_journal = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.490435 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] use_json = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.490709 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.490978 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.491259 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.491533 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.491805 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.492077 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.492348 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.492631 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:06.492929 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.493224 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.493525 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.493835 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.494129 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.494409 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.494698 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.494975 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.495266 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.495555 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.495844 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.496125 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.496412 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.496690 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.496984 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.497287 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.497604 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.497892 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.498167 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.498442 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.498707 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.498988 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.499271 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.499565 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.499854 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.500129 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.500408 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.500696 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.500973 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.501246 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.501525 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.501847 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.502128 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.502402 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.502686 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.502966 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.503240 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.503512 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.503793 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.504087 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.504367 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.504643 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.504918 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.505201 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.505471 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.506322 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.506604 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.506877 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.507151 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.507430 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.507702 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.507975 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.508254 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.508527 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.508805 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.509078 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.509349 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.509646 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.509918 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.510190 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.510462 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.510731 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.511009 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.511280 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.511552 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.511820 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.512092 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.512366 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.512650 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.512948 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.513226 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.513501 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.513798 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.514077 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.514355 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.514631 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.515254 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.515530 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.515805 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.516101 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.516388 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.516677 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.516960 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.517237 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.517532 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.517838 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.518121 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.518399 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.518677 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.518967 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.519249 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.519544 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.519834 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.520127 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.520421 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.520715 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.520994 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.521302 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.522220 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:06.522443 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 02:51:06.522775 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=111166) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Aug 24 02:51:06.870488 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=111166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 02:51:06.870820 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=111166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 02:51:06.871105 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=111166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 02:51:06.871434 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.manager [-] Loading core plugin: ml2 Aug 24 02:51:07.265240 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.265526 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.265825 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.267124 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.267398 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.267671 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.301212 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.301494 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.301783 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.317849 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.318128 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.318950 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.347204 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.347475 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.347734 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.383640 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.383917 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.384184 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.614531 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.615166 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.615166 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.615332 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.616010 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.738230 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.738547 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.738836 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.739102 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.739364 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.739669 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.739924 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.740213 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.740467 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.740744 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.740996 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.741256 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.741506 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.741778 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.742028 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.742289 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.742541 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.742804 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.743069 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.743326 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.743594 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.743844 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.744120 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.744495 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.744740 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.744982 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.745371 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=111166) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Aug 24 02:51:07.745630 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=111166) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Aug 24 02:51:07.745863 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=111166) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Aug 24 02:51:07.746095 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=111166) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Aug 24 02:51:07.746325 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=111166) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Aug 24 02:51:07.746554 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=111166) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Aug 24 02:51:07.746905 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Aug 24 02:51:07.750087 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Aug 24 02:51:07.754189 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Aug 24 02:51:07.757852 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(350, 399)])]) Aug 24 02:51:07.759456 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Aug 24 02:51:07.759906 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Aug 24 02:51:07.760233 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Aug 24 02:51:07.760605 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Aug 24 02:51:07.763381 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Aug 24 02:51:07.763630 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Aug 24 02:51:07.763970 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Aug 24 02:51:07.769197 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Aug 24 02:51:07.791511 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Aug 24 02:51:07.791952 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.792246 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=111166) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Aug 24 02:51:07.792602 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.793955 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=111166) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Aug 24 02:51:07.794232 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Aug 24 02:51:07.794475 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Aug 24 02:51:07.797548 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.797849 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:07.861592 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Aug 24 02:51:07.861841 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Aug 24 02:51:07.862078 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Aug 24 02:51:07.862439 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Aug 24 02:51:07.884462 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_db.sqlalchemy.engines [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 02:51:08.558762 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Initializing driver for type 'gre' Aug 24 02:51:08.559282 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] gre ID ranges: [(1, 1000)] Aug 24 02:51:08.741632 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Initializing driver for type 'local' Aug 24 02:51:08.742218 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Initializing driver for type 'vlan' Aug 24 02:51:08.815567 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] VlanTypeDriver initialization complete Aug 24 02:51:08.815881 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Initializing driver for type 'vxlan' Aug 24 02:51:08.816380 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] vxlan ID ranges: [(1, 1000)] Aug 24 02:51:08.998722 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Initializing extension driver 'port_security' Aug 24 02:51:08.999059 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.extensions.port_security [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] PortSecurityExtensionDriver initialization complete Aug 24 02:51:08.999388 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Initializing mechanism driver 'openvswitch' Aug 24 02:51:08.999705 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Initializing mechanism driver 'hyperv' Aug 24 02:51:09.012566 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.plugins.ml2.plugin [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=111166) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:51:09.013405 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > port after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.013838 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > port after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.014189 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > port after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.014740 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=111166) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Aug 24 02:51:09.015210 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > subnet after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.015562 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > subnet after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.015902 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > subnet after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.016348 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=111166) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Aug 24 02:51:09.016752 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > network after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.017097 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > network after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.017435 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > network after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.017842 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=111166) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Aug 24 02:51:09.018239 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > security_group after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.018587 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > security_group after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.018923 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > security_group after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.019395 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=111166) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Aug 24 02:51:09.019795 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.020138 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.020479 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.020890 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=111166) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Aug 24 02:51:09.021973 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > address_group after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.022394 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > address_group after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.022792 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > address_group after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.023180 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=111166) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Aug 24 02:51:09.023550 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] ML2 OVO RPC backend initialized. {{(pid=111166) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Aug 24 02:51:09.024243 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router_interface after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.024603 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router_interface after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.025003 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > network before_response 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.025348 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > networks before_response 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.025757 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > port before_response 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.026134 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > ports before_response 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.026480 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > subnet before_response 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.026825 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > subnets before_response 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.027169 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > network after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.027504 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > network after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.027875 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > network after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.028210 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > port after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.028542 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > port after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.028871 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > port after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.029204 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > subnet after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.029535 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > subnet after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.029889 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > subnet after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.030462 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.plugin [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Modular L2 Plugin initialization complete Aug 24 02:51:09.030797 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading services supported by the core plugin {{(pid=111166) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Aug 24 02:51:09.031122 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.plugins.ml2.managers [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Got port-security extension from driver 'port_security' Aug 24 02:51:09.031583 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.extensions.vlantransparent [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Disabled vlantransparent extension. Aug 24 02:51:09.032061 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=111166) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Aug 24 02:51:09.032375 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading Plugin: router Aug 24 02:51:09.077304 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router_interface before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.077608 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router after_create 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.077959 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router before_create 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.078321 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router_interface before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.078693 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router_interface after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.079048 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router after_delete 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.079406 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > floatingip after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.079873 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > floatingip after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.080235 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router after_create 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.080582 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router after_update 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.080930 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router after_update 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.081278 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.081662 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router after_update 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.082076 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router precommit_update 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.082446 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: port after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.082786 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: port after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.083170 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: subnet after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.083503 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.084581 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > port precommit_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.084930 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router precommit_create 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.085272 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: port before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.085959 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router precommit_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.086320 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router after_update 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.086659 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router precommit_delete 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.092465 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router precommit_create 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.092465 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router_interface after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.092465 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router precommit_update 55549900 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.092465 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > agent after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.092789 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > agent after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.092789 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > network after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.092789 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Tracking information for resource: router configured {{(pid=111166) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Aug 24 02:51:09.092789 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Tracking information for resource: floatingip configured {{(pid=111166) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Aug 24 02:51:09.094814 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.db.l3_agentschedulers_db [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Aug 24 02:51:09.095387 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: port after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.095748 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: port after_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.096095 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: port after_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.096441 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: port after_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.097221 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router before_create 55550100 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.097598 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router precommit_delete 55550100 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.097971 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router precommit_create 55550100 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.098329 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > router precommit_update 55550100 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.103056 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.services.provider_configuration [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service providers = [] {{(pid=111166) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Aug 24 02:51:09.103423 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.db.servicetype_db [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=111166) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Aug 24 02:51:09.106393 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.services.service_base [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=111166) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Aug 24 02:51:09.106742 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.services.service_base [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=111166) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Aug 24 02:51:09.107082 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.services.service_base [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=111166) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Aug 24 02:51:09.107978 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.services.service_base [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=111166) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Aug 24 02:51:09.108354 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.services.service_base [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Default provider is not specified for service type L3_ROUTER_NAT Aug 24 02:51:09.108725 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=111166) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Aug 24 02:51:09.109040 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Aug 24 02:51:09.124906 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Successfully loaded METERING plugin. Description: METERING {{(pid=111166) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Aug 24 02:51:09.125242 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading Plugin: auto_allocate Aug 24 02:51:09.131762 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: network precommit_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.132123 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: network precommit_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.132634 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=111166) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Aug 24 02:51:09.132950 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading Plugin: tag Aug 24 02:51:09.139698 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=111166) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Aug 24 02:51:09.140028 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading Plugin: timestamp Aug 24 02:51:09.143815 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=111166) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Aug 24 02:51:09.144147 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading Plugin: network_ip_availability Aug 24 02:51:09.149761 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.150129 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.150484 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.156153 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=111166) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Aug 24 02:51:09.156153 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading Plugin: flavors Aug 24 02:51:09.160678 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=111166) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Aug 24 02:51:09.161008 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading Plugin: revisions Aug 24 02:51:09.165302 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=111166) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Aug 24 02:51:09.165731 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_concurrency.lockutils [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 2.294s {{(pid=111166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 02:51:09.166453 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=111166) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}} Aug 24 02:51:09.166790 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Initializing extension manager. Aug 24 02:51:09.167294 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: __init__.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.167725 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: __pycache__ {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.168067 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.168400 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: address_group.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.169153 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.169752 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: address-group Aug 24 02:51:09.170076 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: address_scope.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.170822 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.171333 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: address-scope Aug 24 02:51:09.171653 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: admin_state_down_before_update.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.172571 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.173080 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: router-admin-state-down-before-update Aug 24 02:51:09.173401 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: agent.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.174125 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.174661 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: agent Aug 24 02:51:09.174973 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: agent_resources_synced.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.175875 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.176375 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: agent-resources-synced Aug 24 02:51:09.176694 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: allowedaddresspairs.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.179008 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.179547 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: allowed-address-pairs Aug 24 02:51:09.179873 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: auto_allocated_topology.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.180941 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.181497 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: auto-allocated-topology Aug 24 02:51:09.188506 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: availability_zone.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.188506 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.188506 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: availability_zone Aug 24 02:51:09.188506 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: availability_zone_filter.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.189192 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.189728 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: availability_zone_filter Aug 24 02:51:09.190053 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: data_plane_status.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.190957 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.191455 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension data-plane-status not supported by any of loaded plugins Aug 24 02:51:09.191814 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: default_subnetpools.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.192685 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.193815 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: default-subnetpools Aug 24 02:51:09.194154 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: dhcpagentscheduler.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.194954 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.195455 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: dhcp_agent_scheduler Aug 24 02:51:09.195775 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: dns.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.196680 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.197187 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension dns-integration not supported by any of loaded plugins Aug 24 02:51:09.197559 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: dns_domain_ports.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.198490 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.199000 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension dns-domain-ports not supported by any of loaded plugins Aug 24 02:51:09.199312 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.200223 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.200726 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Aug 24 02:51:09.201052 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: dvr.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.201753 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.202256 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: dvr Aug 24 02:51:09.202577 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: ecmp_routes.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.203479 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.203979 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension ecmp_routes not supported by any of loaded plugins Aug 24 02:51:09.204298 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: empty_string_filtering.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.205197 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.205732 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: empty-string-filtering Aug 24 02:51:09.206052 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.206952 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.207454 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Aug 24 02:51:09.207771 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.208674 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.209678 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Aug 24 02:51:09.210004 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: external_net.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.211474 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.211984 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: external-net Aug 24 02:51:09.212307 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: extra_dhcp_opt.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.213209 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.213782 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: extra_dhcp_opt Aug 24 02:51:09.214111 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: extraroute.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.215008 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.215517 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: extraroute Aug 24 02:51:09.215835 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: extraroute_atomic.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.216857 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.217369 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: extraroute-atomic Aug 24 02:51:09.217723 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: filter_validation.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.218545 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.219054 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: filter-validation Aug 24 02:51:09.219377 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: fip_pf_description.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.220286 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.220784 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Aug 24 02:51:09.221105 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: fip_port_details.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.222039 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.222543 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: fip-port-details Aug 24 02:51:09.222861 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: flavors.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.224068 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.224762 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: flavors Aug 24 02:51:09.225091 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.226818 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.227327 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Aug 24 02:51:09.227654 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: floatingip_pools.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.228348 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.228856 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: floatingip-pools Aug 24 02:51:09.229178 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: ip_allocation.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.230115 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.230620 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension ip_allocation not supported by any of loaded plugins Aug 24 02:51:09.230942 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: ip_substring_port_filtering.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.237569 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.238092 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: ip-substring-filtering Aug 24 02:51:09.238414 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: l2_adjacency.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.239330 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.239827 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension l2_adjacency not supported by any of loaded plugins Aug 24 02:51:09.240682 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: l3.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.241746 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.242263 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: router Aug 24 02:51:09.242586 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: l3_conntrack_helper.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.244800 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.245319 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension l3-conntrack-helper not supported by any of loaded plugins Aug 24 02:51:09.245674 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: l3_ext_gw_mode.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.246607 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.247120 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: ext-gw-mode Aug 24 02:51:09.247450 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: l3_ext_ha_mode.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.248406 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.248923 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: l3-ha Aug 24 02:51:09.249248 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: l3_flavors.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.250190 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.250698 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: l3-flavors Aug 24 02:51:09.251020 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.251925 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.252428 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: l3-port-ip-change-not-allowed Aug 24 02:51:09.252748 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: l3agentscheduler.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.253819 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.254335 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: l3_agent_scheduler Aug 24 02:51:09.254729 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: logging.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.256864 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.257388 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension logging not supported by any of loaded plugins Aug 24 02:51:09.257750 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: metering.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.258492 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.259067 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: metering Aug 24 02:51:09.259391 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.260595 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.261150 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: metering_source_and_destination_fields Aug 24 02:51:09.261481 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: multiprovidernet.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.269782 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.270287 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: multi-provider Aug 24 02:51:09.270614 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: netmtu.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.271654 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.272165 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: net-mtu Aug 24 02:51:09.272488 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: netmtu_writable.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.273411 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.273952 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: net-mtu-writable Aug 24 02:51:09.274316 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: network_availability_zone.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.274983 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.275494 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: network_availability_zone Aug 24 02:51:09.275816 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: network_ip_availability.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.276901 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.277408 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: network-ip-availability Aug 24 02:51:09.277783 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: network_segment_range.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.278538 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.279033 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension network-segment-range not supported by any of loaded plugins Aug 24 02:51:09.279352 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: pagination.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.280324 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.280651 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: pagination Aug 24 02:51:09.280969 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: port_device_profile.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.281903 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.282417 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: port-device-profile Aug 24 02:51:09.282738 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: port_mac_address_regenerate.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.283657 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.284165 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: port-mac-address-regenerate Aug 24 02:51:09.284484 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: port_numa_affinity_policy.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.285465 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.285999 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: port-numa-affinity-policy Aug 24 02:51:09.286317 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: port_resource_request.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.287256 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.287756 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension port-resource-request not supported by any of loaded plugins Aug 24 02:51:09.288073 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: portbindings.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.289016 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.289520 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: binding Aug 24 02:51:09.289872 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: portbindings_extended.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.291120 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.291633 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: binding-extended Aug 24 02:51:09.291955 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: portsecurity.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.292869 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.293380 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: port-security Aug 24 02:51:09.293733 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: project_id.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.294732 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.295068 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: project-id Aug 24 02:51:09.295388 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: providernet.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.296300 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.296858 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: provider Aug 24 02:51:09.297177 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: qos.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.300749 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.301306 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension qos not supported by any of loaded plugins Aug 24 02:51:09.301673 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: qos_bw_limit_direction.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.303669 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.304184 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Aug 24 02:51:09.304516 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.305437 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.305978 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Aug 24 02:51:09.306305 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: qos_default.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.307216 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.307728 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension qos-default not supported by any of loaded plugins Aug 24 02:51:09.308053 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: qos_fip.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.308703 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.309203 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension qos-fip not supported by any of loaded plugins Aug 24 02:51:09.309524 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: qos_gateway_ip.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.310463 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.310967 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension qos-gateway-ip not supported by any of loaded plugins Aug 24 02:51:09.311288 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: qos_port_network_policy.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.312194 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.312702 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension qos-port-network-policy not supported by any of loaded plugins Aug 24 02:51:09.313022 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: qos_pps_rule.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.314205 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.314723 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension qos-pps not supported by any of loaded plugins Aug 24 02:51:09.315047 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: qos_rule_type_details.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.315958 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.316468 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension qos-rule-type-details not supported by any of loaded plugins Aug 24 02:51:09.316790 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: qos_rules_alias.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.317836 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.318461 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension qos-rules-alias not supported by any of loaded plugins Aug 24 02:51:09.318782 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: quotasv2.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.319859 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.320186 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: quotas Aug 24 02:51:09.320507 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: quotasv2_detail.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.323703 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.324056 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: quota_details Aug 24 02:51:09.324393 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: rbac.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.325449 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.326004 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: rbac-policies Aug 24 02:51:09.326335 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: rbac_address_group.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.327273 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.327834 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: rbac-address-group Aug 24 02:51:09.328114 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: rbac_address_scope.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.329025 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.329537 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: rbac-address-scope Aug 24 02:51:09.329943 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: rbac_security_groups.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.330794 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.331307 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: rbac-security-groups Aug 24 02:51:09.331630 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: rbac_subnetpool.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.332542 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.333052 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: rbac-subnetpool Aug 24 02:51:09.333373 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: revisionifmatch.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.335037 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.335815 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: revision-if-match Aug 24 02:51:09.336142 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: revisions.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.337248 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.337799 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: standard-attr-revisions Aug 24 02:51:09.338127 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: router_availability_zone.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.338799 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.339310 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: router_availability_zone Aug 24 02:51:09.339634 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: routerservicetype.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.340549 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.341056 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension router-service-type not supported by any of loaded plugins Aug 24 02:51:09.341377 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.342329 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.342844 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: security-groups-normalized-cidr Aug 24 02:51:09.343162 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: security_groups_port_filtering.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.344071 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.344580 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: port-security-groups-filtering Aug 24 02:51:09.344900 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: security_groups_remote_address_group.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.345848 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.346360 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: security-groups-remote-address-group Aug 24 02:51:09.346679 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: securitygroup.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.356882 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.357404 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: security-group Aug 24 02:51:09.357777 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: segment.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.358560 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.359067 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension segment not supported by any of loaded plugins Aug 24 02:51:09.359394 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.360327 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.360835 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Aug 24 02:51:09.361166 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: servicetype.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.362344 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.362863 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: service-type Aug 24 02:51:09.363189 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: sorting.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.364164 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.364495 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: sorting Aug 24 02:51:09.364816 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: standard_attr_segment.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.365943 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.366455 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension standard-attr-segment not supported by any of loaded plugins Aug 24 02:51:09.366777 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: standardattrdescription.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.367425 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.367934 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: standard-attr-description Aug 24 02:51:09.368256 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: stateful_security_group.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.369185 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.369807 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: stateful-security-group Aug 24 02:51:09.370132 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: stdattrs_common.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.370709 dv-cinder-803748-8-iscsi neutron-server[111166]: WARNING neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Aug 24 02:51:09.371027 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.371955 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.372461 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Aug 24 02:51:09.372779 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: subnet_onboard.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.373873 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.374391 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: subnet_onboard Aug 24 02:51:09.374714 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: subnet_segmentid_writable.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.375636 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.376145 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Aug 24 02:51:09.376469 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: subnet_service_types.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.377381 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.377925 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: subnet-service-types Aug 24 02:51:09.378248 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: subnetallocation.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.379314 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.379829 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: subnet_allocation Aug 24 02:51:09.380149 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.381000 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.381511 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: subnetpool-prefix-ops Aug 24 02:51:09.381866 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.382800 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.383316 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Aug 24 02:51:09.383639 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: tagging.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.384684 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.385198 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: standard-attr-tag Aug 24 02:51:09.385521 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: timestamp.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.386747 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.387263 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loaded extension: standard-attr-timestamp Aug 24 02:51:09.387588 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: trunk.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.388608 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.389122 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension trunk not supported by any of loaded plugins Aug 24 02:51:09.389446 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: trunk_details.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.390395 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.390912 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension trunk-details not supported by any of loaded plugins Aug 24 02:51:09.391235 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: uplink_status_propagation.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.392142 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.392653 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension uplink-status-propagation not supported by any of loaded plugins Aug 24 02:51:09.392975 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Loading extension file: vlantransparent.py {{(pid=111166) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} Aug 24 02:51:09.393665 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=111166) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} Aug 24 02:51:09.394171 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extension vlan-transparent not supported by any of loaded plugins Aug 24 02:51:09.397082 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:network Aug 24 02:51:09.397628 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:subnet Aug 24 02:51:09.398026 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:subnetpool Aug 24 02:51:09.398421 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:port Aug 24 02:51:09.399625 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.400054 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service FLAVORS assigned prefix: {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.400658 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.401086 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.401412 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:router Aug 24 02:51:09.401901 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:floatingip Aug 24 02:51:09.402417 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service METERING assigned prefix: /metering {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.403824 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.404188 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.404535 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=111166) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 02:51:09.405505 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of CountableResource for resource:rbac_policy Aug 24 02:51:09.405971 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:security_group Aug 24 02:51:09.406397 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:security_group_rule Aug 24 02:51:09.407000 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service CORE assigned prefix: {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.407335 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:subnetpool Aug 24 02:51:09.407679 dv-cinder-803748-8-iscsi neutron-server[111166]: WARNING neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] subnetpool is already registered Aug 24 02:51:09.408099 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service CORE assigned prefix: {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.408421 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:subnetpool Aug 24 02:51:09.408748 dv-cinder-803748-8-iscsi neutron-server[111166]: WARNING neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] subnetpool is already registered Aug 24 02:51:09.411041 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.411588 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service FLAVORS assigned prefix: {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.412745 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.413176 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.413508 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:router Aug 24 02:51:09.413869 dv-cinder-803748-8-iscsi neutron-server[111166]: WARNING neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] router is already registered Aug 24 02:51:09.414285 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:floatingip Aug 24 02:51:09.414620 dv-cinder-803748-8-iscsi neutron-server[111166]: WARNING neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] floatingip is already registered Aug 24 02:51:09.415068 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service METERING assigned prefix: /metering {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.415769 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of CountableResource for resource:rbac_policy Aug 24 02:51:09.416103 dv-cinder-803748-8-iscsi neutron-server[111166]: WARNING neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] rbac_policy is already registered Aug 24 02:51:09.416523 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:security_group Aug 24 02:51:09.416857 dv-cinder-803748-8-iscsi neutron-server[111166]: WARNING neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] security_group is already registered Aug 24 02:51:09.417266 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:security_group_rule Aug 24 02:51:09.417629 dv-cinder-803748-8-iscsi neutron-server[111166]: WARNING neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] security_group_rule is already registered Aug 24 02:51:09.418116 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service CORE assigned prefix: {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.418445 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:subnetpool Aug 24 02:51:09.418775 dv-cinder-803748-8-iscsi neutron-server[111166]: WARNING neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] subnetpool is already registered Aug 24 02:51:09.419189 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.v2.resource_helper [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Service CORE assigned prefix: {{(pid=111166) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Aug 24 02:51:09.419508 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Creating instance of TrackedResource for resource:subnetpool Aug 24 02:51:09.419834 dv-cinder-803748-8-iscsi neutron-server[111166]: WARNING neutron.quota.resource_registry [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] subnetpool is already registered Aug 24 02:51:09.421452 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: extensions {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.422927 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: address-groups {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.424410 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: address-scopes {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.425610 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: agents {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.426875 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: auto-allocated-topology {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.428461 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: availability_zones {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.429712 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: dhcp-networks {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.431137 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: dhcp-agents {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.432659 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: routers {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.434374 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: flavors {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.435545 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: service_profiles {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.436864 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: next_providers {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.438316 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: service_profiles {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.439878 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: floatingip-pools {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.441194 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: routers {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.442935 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: floatingips {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.444236 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: l3-routers {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.445757 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: l3-agents {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.447174 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: metering-labels {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.448406 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: metering-label-rules {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.449696 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: network-ip-availabilities {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.451044 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: bindings {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.452606 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: quotas {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.454082 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: quotas {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.455596 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: rbac-policies {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.456792 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: security-groups {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.458041 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: security-group-rules {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.460060 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: service-providers {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.461541 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: subnetpools {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.462880 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: subnetpools {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.464428 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: tags {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.466141 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: tags {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.467859 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: tags {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.469742 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: tags {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.471536 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: tags {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.473383 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: tags {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.476182 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: tags {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.478009 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: tags {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.480779 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: tags {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.482758 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron.api.extensions [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Extended resource: tags {{(pid=111166) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Aug 24 02:51:09.488818 dv-cinder-803748-8-iscsi neutron-server[111166]: WARNING keystonemiddleware.auth_token [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 02:51:09.493724 dv-cinder-803748-8-iscsi neutron-server[111166]: WARNING keystonemiddleware.auth_token [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 02:51:09.502184 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_concurrency.lockutils [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Acquired lock "singleton_lock" {{(pid=111166) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 24 02:51:09.502657 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_concurrency.lockutils [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Releasing lock "singleton_lock" {{(pid=111166) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 24 02:51:09.503296 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO oslo_service.service [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Starting 2 workers Aug 24 02:51:09.508775 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Started child 111275 {{(pid=111166) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Aug 24 02:51:09.513249 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Started child 111276 {{(pid=111166) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Aug 24 02:51:09.514041 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:09.514850 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO neutron.service [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Neutron service started, listening on 0.0.0.0:9696 Aug 24 02:51:09.515509 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Notify callbacks [] for process, before_spawn {{(pid=111166) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:09.515664 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [-] (111275) wsgi starting up on http://0.0.0.0:9696 Aug 24 02:51:09.517908 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:09.518329 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO oslo_service.service [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Starting 1 workers Aug 24 02:51:09.519245 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [-] (111276) wsgi starting up on http://0.0.0.0:9696 Aug 24 02:51:09.523839 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Started child 111277 {{(pid=111166) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Aug 24 02:51:09.524364 dv-cinder-803748-8-iscsi neutron-server[111166]: INFO oslo_service.service [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Starting 1 workers Aug 24 02:51:09.527287 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.service [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] calling RpcWorker wait() {{(pid=111277) _wait /opt/stack/neutron/neutron/service.py:128}} Aug 24 02:51:09.527801 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.service [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] returning from RpcWorker wait() {{(pid=111277) _wait /opt/stack/neutron/neutron/service.py:135}} Aug 24 02:51:09.528870 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Started child 111278 {{(pid=111166) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Aug 24 02:51:09.529177 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:09.529679 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:51:09.529772 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG neutron_lib.callbacks.manager [None req-9cc048c9-0607-4d3a-938f-04db2176343a None None] Notify callbacks [] for process, after_spawn {{(pid=111166) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:09.531511 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=111166) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Aug 24 02:51:09.531729 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 02:51:09.531910 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 02:51:09.532122 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 02:51:09.532478 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 02:51:09.532620 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 02:51:09.533145 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.533424 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.533712 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.533968 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.534257 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.534516 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:09.535066 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.535066 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.535332 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.535615 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.535863 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.536032 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.536195 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.536443 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.536686 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.537006 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.537445 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.537748 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.538001 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.538169 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.538421 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] config_source = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.538701 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.538954 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.539211 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] debug = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.539449 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.539929 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.540161 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.540398 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.540631 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.540928 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.541169 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.541427 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.541691 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.541925 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.542180 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.542432 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.542661 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.542871 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.543125 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.543375 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.543599 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.544060 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] host = dv-cinder-803748-8-iscsi {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.544282 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.544520 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.544767 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.545008 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.545266 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.545485 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.545773 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.546029 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.546279 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.546504 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.546776 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.547036 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.547285 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_dir = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.547522 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_file = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.547684 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_options = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.547919 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.548200 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.548471 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.548658 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.548826 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.549002 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.549271 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.549434 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.549715 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.549964 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.550178 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.550391 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.550624 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.550858 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.551095 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.551325 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.551540 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.551767 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.552024 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.552249 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.552472 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.552755 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.552976 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.553232 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.553471 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.553777 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.554009 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.554241 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.554455 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.554730 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.554962 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.555234 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.555470 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.555726 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.555975 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.556201 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.556455 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.556722 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.556952 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.557209 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.557455 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.557835 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.557965 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.558165 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.558394 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] use_journal = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.558623 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] use_json = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.558854 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.559084 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.559334 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.559548 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.559760 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.559975 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.560207 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.560438 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.560863 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.562244 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.562363 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.562576 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.562863 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.563134 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.563437 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.563695 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.564077 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.564346 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.564683 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.564942 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.565252 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.565506 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.565842 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.566193 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.566444 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.566740 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.567007 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.567268 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.567496 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.567726 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.568677 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.568956 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.569249 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.30/identity {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.569535 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.577707 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.577707 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.577911 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:51:09.578004 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578004 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578004 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578004 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578004 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578004 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578004 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578004 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578004 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578634 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578634 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578634 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578634 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578634 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578634 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578634 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578634 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.578634 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579226 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579226 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579226 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579226 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579226 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579226 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579226 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579226 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579226 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579833 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579833 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579833 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579833 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579833 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579833 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579833 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579833 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.579833 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.580473 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.580473 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.580473 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.580473 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.580473 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.580473 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.580473 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.580473 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.580473 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.581270 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.581270 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.581270 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.581270 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.581766 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.581890 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.582037 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.582307 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.582491 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.582727 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.582968 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.583251 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.583577 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.584539 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.584815 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.585043 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.585379 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.586012 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.586259 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.586519 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.586746 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.586982 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.587246 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.587479 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.587732 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.587999 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.588314 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.588599 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.588919 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.589105 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.589408 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.589698 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.589955 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.590237 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.590497 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.590755 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.591024 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.591285 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.591535 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.591872 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.592129 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.592348 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.592619 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.592904 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.593176 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.593439 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.593708 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.593956 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.594204 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.594432 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.594697 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.594907 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.595154 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.595404 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.595732 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.595965 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.596213 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.596396 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.596623 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.596960 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.597215 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.597467 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.597697 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.597989 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.598247 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.598506 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.598848 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.599117 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.599369 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.599784 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.600093 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.30/identity {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.600409 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.600653 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.600893 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.601114 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.601334 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.601553 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.601837 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.602054 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.602270 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.602510 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.602730 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.602949 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.603183 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.603404 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.603622 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.603897 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.604115 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.604342 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.604582 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.604821 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.605041 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.605262 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.605480 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.605795 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.606020 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.606289 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.606544 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.606780 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.607011 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.607239 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.607508 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.607726 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.607975 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.608201 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.608419 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.608633 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.608855 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.609077 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.609319 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.609551 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.609813 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.610084 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.610328 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.612981 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.613276 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.613529 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.613818 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.614055 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.614323 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.614577 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.614829 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.615104 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.615406 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.615704 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.615969 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.616204 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.616465 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.616692 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.616939 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.617157 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.617384 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.618195 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.618887 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.619165 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.619417 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.619681 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.620032 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.620288 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.620549 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.620768 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.620985 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.621211 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.621444 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.621696 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.621930 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.622149 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.622364 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.622590 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.622811 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.623023 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.623250 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.623487 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.623702 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.623927 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.624146 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.624360 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.624629 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.624891 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.625106 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.625330 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.625571 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.625805 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.626034 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.626247 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.626462 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.626708 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.626900 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.627111 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.627418 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.627670 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.627890 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.628182 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.628422 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.628682 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.628930 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.629248 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.629484 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.629759 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.629997 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.630232 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.630481 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.631399 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.631736 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.632021 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.632292 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.632548 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.632823 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.633100 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:350:399'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.633666 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.633913 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.634200 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.634644 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.634925 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.635188 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.635443 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.636110 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.637703 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.637703 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.637703 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.637703 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.637703 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.638074 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.638074 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.638232 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.638458 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.638690 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.638939 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.639211 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.639447 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.639680 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.639918 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.640156 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 02:51:09.641022 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=111166) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Aug 24 02:51:09.641022 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 02:51:09.641022 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 02:51:09.641233 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 02:51:09.641233 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 02:51:09.641376 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 02:51:09.641562 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.641748 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.642183 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.642352 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.642513 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.642697 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.642863 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.643427 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.643604 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.644429 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.644594 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.645148 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.645320 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.647133 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.647312 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.647483 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.647645 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.647811 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.647981 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.648155 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] config_source = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.648300 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.648465 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.648625 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] debug = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.648790 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.648991 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.649158 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.649318 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.649478 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.649991 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.650163 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.650327 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.650490 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.650661 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.650831 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.650985 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.651126 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.651286 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.651447 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.651605 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.652310 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.652498 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] host = dv-cinder-803748-8-iscsi {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.652655 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.653942 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.654113 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.654590 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.654756 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.654924 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.655127 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.655456 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.655617 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.655772 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.655938 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.656091 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.656252 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_dir = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.656419 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_file = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.656581 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_options = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.656739 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.656883 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.657045 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.657238 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.657408 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.657562 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.657753 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.657906 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.658066 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.658226 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.658377 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.658540 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.658701 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.658846 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.659009 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.659161 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.659322 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.659482 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.659643 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.659796 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.659958 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.660110 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.660272 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.660507 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.660601 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.660819 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.660900 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.661062 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.661216 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.661369 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.661502 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.661667 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.661845 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.662013 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.662176 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.662498 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.662669 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.662835 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.662997 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.663151 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.663297 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.663451 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.663613 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.663776 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.663934 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] use_journal = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.664081 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] use_json = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.664241 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.664385 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.664549 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.664693 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.664857 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.665002 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.665151 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.665298 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 02:51:09.665483 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.665670 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.665837 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.666012 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.666158 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.666298 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.666591 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.666775 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.666935 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.667095 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.667276 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.667982 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.668163 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.668325 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.668489 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.668659 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.668827 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.668975 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.669629 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.669629 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.671052 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.671234 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.671429 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.671601 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.671775 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.30/identity {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.671943 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.672108 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.672274 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.672440 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.672606 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.672776 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.672939 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.673103 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.673267 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.673435 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.673884 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.674324 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.674491 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.674657 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.674855 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.675031 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.675192 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.675359 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.675527 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.675693 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.675848 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.676016 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.676178 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.676346 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.676510 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.676683 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.676881 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.677055 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.677658 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.677873 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.678247 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.678247 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.678399 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.678576 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.678750 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.678922 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.679108 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.679278 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.679446 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.679611 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.679777 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.679941 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.680105 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.680269 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.680432 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.680596 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.680780 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.680946 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.681109 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.681270 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.681434 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.681644 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.681763 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.681936 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.682097 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.682259 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.682421 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.682584 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.682747 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.682919 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.683098 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.683265 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.683433 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.683595 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.683758 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.683920 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.684082 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.684247 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.684410 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.684574 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.684735 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.684896 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.685062 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.685225 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.685500 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.685690 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.685854 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.686015 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.686180 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.686341 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.686504 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.686667 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.686830 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.686992 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.687154 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.687316 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.687487 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.687649 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.687812 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.687974 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.688143 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.688320 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.688484 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.688645 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.688806 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.688891 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:51:09.688976 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.689117 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.689279 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.689441 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.689620 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.689785 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.689946 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.690115 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.690288 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.690452 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.690615 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.690776 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.690961 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.691122 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.691282 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.691445 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.691611 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.691775 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.691936 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.692096 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.692258 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.692420 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.692582 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.692745 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.30/identity {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.692907 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.693625 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.693872 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.694042 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.694159 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.694326 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.694491 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.694654 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.694817 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.694978 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.695140 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.695301 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.695462 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.695624 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.695787 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.695949 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.696112 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.696274 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.696437 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.696600 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.696762 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.696923 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.697083 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.697245 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.697406 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.697570 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.697751 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.697915 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.698078 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.698241 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.698471 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.698568 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.698745 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.698907 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.699069 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.699232 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.699393 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.699557 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.699721 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.699884 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.700842 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.700842 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.700842 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.700842 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.700842 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.700842 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.701330 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.701330 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.701330 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.701782 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.701782 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.701782 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.702911 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.702911 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.702911 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.702911 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.702911 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.702911 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.702911 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.702911 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.703658 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.703658 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.703658 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.703658 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.703658 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.704036 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.704036 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.704559 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.704559 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.704559 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.704559 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.704966 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.704966 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.705157 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.705268 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.705372 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.705474 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.705653 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.706009 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.706009 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.706247 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.706330 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.706430 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.706592 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.706753 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.706914 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.707086 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.707247 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.707408 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.707570 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.707730 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.707892 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.708063 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.708333 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.708449 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.708634 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.708743 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.709254 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.709254 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.709254 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.709607 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.709607 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.709801 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.709880 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.709999 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.710174 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.710336 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.710764 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.710928 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.711090 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.711252 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.711416 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.711585 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.711749 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.711928 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.712070 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.712240 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.712411 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:350:399'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.712581 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.712744 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.712912 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.713084 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.713254 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.713381 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.713548 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.713749 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.713911 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.714072 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.714234 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.714396 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.714605 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.714746 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.714869 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.714989 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.715152 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.715314 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.715464 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.715665 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.715783 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.715909 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.716069 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 02:51:09.716223 dv-cinder-803748-8-iscsi neutron-server[111166]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=111166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 02:51:09.945597 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 57400) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:51:09.954069 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [-] 10.222.0.30 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0062027 Aug 24 02:51:21.412577 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0acf8152-a8eb-4c11-ac74-68a96c465504 None None] get_active_networks_info from dv-cinder-803748-8-iscsi {{(pid=111277) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Aug 24 02:51:21.480790 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0acf8152-a8eb-4c11-ac74-68a96c465504 None None] No non-hosted networks {{(pid=111277) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Aug 24 02:51:21.488257 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.agentschedulers_db [None req-0acf8152-a8eb-4c11-ac74-68a96c465504 None None] DHCP Agent not found on host dv-cinder-803748-8-iscsi {{(pid=111277) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Aug 24 02:51:21.612497 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-74c77c26-eb37-442b-96bf-b4027f50b5f3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-566067'] for agent, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:23.904138 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-561a3215-f87b-4472-a078-e4ef773765e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-566067'] for agent, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:23.931251 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.db.api [None req-080079cd-c3e1-4300-9284-5c0cc1a32447 None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-cinder-803748-8-iscsi {{(pid=111277) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Aug 24 02:51:23.931674 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG oslo_db.api [None req-080079cd-c3e1-4300-9284-5c0cc1a32447 None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Aug 24 02:51:24.335403 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-566067'] for agent, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:24.336309 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:24.336828 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:24.337334 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:24.337856 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:24.338338 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:24.338811 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:24.339299 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:24.339818 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:24.340298 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:24.343971 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:24.344537 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:24.345248 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:24.347677 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-803748-8-iscsi', {'QosPolicy': '1.9', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:51:24.358671 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-803748-8-iscsi', 'version_map': {'QosPolicy': '1.9', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:51:24.466887 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-080079cd-c3e1-4300-9284-5c0cc1a32447 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:25.543728 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-566067'] for agent, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:26.913455 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-566067'] for agent, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:26.952177 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.db.l3_hamode_db [None req-422c6e2f-9c84-4882-b698-5284e5afead1 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Aug 24 02:51:27.030141 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-422c6e2f-9c84-4882-b698-5284e5afead1 None None] Routers set() bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:51:27.030520 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-422c6e2f-9c84-4882-b698-5284e5afead1 None None] Router IDs set() for agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Aug 24 02:51:28.062570 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 57490) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:51:28.554449 dv-cinder-803748-8-iscsi neutron-server[111275]: WARNING oslo_policy.policy [None req-a0d77743-a1f2-4b4b-8b76-ef82d6115f79 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Aug 24 02:51:28.555063 dv-cinder-803748-8-iscsi neutron-server[111275]: WARNING oslo_policy.policy [None req-a0d77743-a1f2-4b4b-8b76-ef82d6115f79 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Aug 24 02:51:28.772685 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [None req-a0d77743-a1f2-4b4b-8b76-ef82d6115f79 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=111275) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Aug 24 02:51:28.773802 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a0d77743-a1f2-4b4b-8b76-ef82d6115f79 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.7091038 Aug 24 02:51:31.109219 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 57504) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:51:31.414126 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-5caca9e8-df97-4cb6-beab-ebf061739065 admin admin] Request body: {'subnetpool': {'shared': True, 'default_prefixlen': 26, 'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16'], 'is_default': True}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:51:31.507883 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.policy [None req-5caca9e8-df97-4cb6-beab-ebf061739065 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=111275) register_rules /opt/stack/neutron/neutron/policy.py:73}} Aug 24 02:51:31.552844 dv-cinder-803748-8-iscsi neutron-server[111275]: WARNING oslo_policy.policy [None req-5caca9e8-df97-4cb6-beab-ebf061739065 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Aug 24 02:51:31.553216 dv-cinder-803748-8-iscsi neutron-server[111275]: WARNING oslo_policy.policy [None req-5caca9e8-df97-4cb6-beab-ebf061739065 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Aug 24 02:51:31.561725 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.quota [None req-5caca9e8-df97-4cb6-beab-ebf061739065 admin admin] Loaded quota_driver: . Aug 24 02:51:31.732214 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5caca9e8-df97-4cb6-beab-ebf061739065 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732367683553', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732367651090', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732367662747', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732367664964', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732367908349', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732367881191', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-16338958', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-16229583', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-480389', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-453004'] for rbac-policy, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:31.952203 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5caca9e8-df97-4cb6-beab-ebf061739065 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:31.953329 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-5caca9e8-df97-4cb6-beab-ebf061739065 admin admin] 10.222.0.30 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.8431044 Aug 24 02:51:34.491710 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 57516) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:51:34.788091 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Request body: {'network': {'name': 'private', 'admin_state_up': True, 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'project_id': '9f92985399604c9db21b1697c9d19390'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:51:34.991962 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Made reservation on behalf of 9f92985399604c9db21b1697c9d19390 for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:51:34.994763 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:35.012000 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:35.131720 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:35.180825 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:35.204085 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] vlan segment allocate from pool success with {'vlan_id': 369, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 02:51:35.228776 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8732364285462', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:35.229355 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Unsubscribe: segment precommit_create {{(pid=111275) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Aug 24 02:51:35.229879 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Added segment a153d795-6211-46b2-8f0b-7ad2b960789e of type vlan for network 0eb7a116-2a77-4328-bf89-9d4de60476a4 Aug 24 02:51:35.235372 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41f86cc9-9825-446e-be1e-4c5153059cec,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:51:35.270630 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:35.270925 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:35.271265 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:35.271595 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:35.271918 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:35.272252 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:35.272583 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:35.272915 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:35.273253 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:35.273590 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:35.273908 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:35.274220 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Tracked resource versions report: Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: pushed versions: Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: { 'AddressGroup': {'1.2'}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'ConntrackHelper': {'1.0'}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Log': {'1.0'}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Network': {'1.1'}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Port': {'1.7'}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'PortForwarding': {'1.2'}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'QosPolicy': {'1.9'}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'SecurityGroup': {'1.4'}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'SecurityGroupRule': {'1.2'}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'SubPort': {'1.0'}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Subnet': {'1.1'}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Trunk': {'1.1'}} Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: consumer versions: Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: { DHCP agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: L3 agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: Metadata agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: Metering agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: Open vSwitch agent@dv-cinder-803748-8-iscsi: { 'AddressGroup': '1.2', Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'ConntrackHelper': '1.0', Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Log': '1.0', Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Network': '1.1', Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Port': '1.7', Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'PortForwarding': '1.2', Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'QosPolicy': '1.9', Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'SecurityGroup': '1.4', Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'SecurityGroupRule': '1.2', Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'SubPort': '1.0', Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Subnet': '1.1', Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Trunk': '1.1'}} Aug 24 02:51:35.275268 dv-cinder-803748-8-iscsi neutron-server[111275]: {{(pid=111275) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Aug 24 02:51:35.346067 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:35.449378 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:35.450624 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:51:35.451287 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:35.546645 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] Pushing event updated for resources: {'Network': ['ID=0eb7a116-2a77-4328-bf89-9d4de60476a4,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:51:35.559293 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 0eb7a116-2a77-4328-bf89-9d4de60476a4 details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 02:51:35.604523 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-bfd2ed3d-d12f-42f0-b07d-34e4ea5de3b9 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 1.1117368 Aug 24 02:51:38.233792 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 57530) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:51:38.623462 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4ab5d19-9667-47e2-8cf9-f10b9baa5395 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:51:38.624819 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-f4ab5d19-9667-47e2-8cf9-f10b9baa5395 admin admin] 10.222.0.30 "GET /v2.0/networks/0eb7a116-2a77-4328-bf89-9d4de60476a4 HTTP/1.1" status: 200 len: 825 time: 0.3900898 Aug 24 02:51:38.649534 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a381a8df-1ece-495a-b8ee-39aba850b7af admin admin] 10.222.0.30 "GET /v2.0/subnetpools/1cf8c3d6-cdef-49e4-a7c1-8fbb4ce3a43d HTTP/1.1" status: 200 len: 734 time: 0.0187652 Aug 24 02:51:38.658489 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-25045c7c-200f-430e-9128-4b453061977a admin admin] Request body: {'subnet': {'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4', 'gateway_ip': '172.20.0.1', 'ip_version': 4, 'subnetpool_id': '1cf8c3d6-cdef-49e4-a7c1-8fbb4ce3a43d', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'name': 'private-subnet'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:51:38.740581 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25045c7c-200f-430e-9128-4b453061977a admin admin] Made reservation on behalf of 9f92985399604c9db21b1697c9d19390 for: {'subnet': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:51:38.742858 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-25045c7c-200f-430e-9128-4b453061977a admin admin] Notify callbacks [] for subnet, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:39.071582 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-25045c7c-200f-430e-9128-4b453061977a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for subnet, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:39.138955 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25045c7c-200f-430e-9128-4b453061977a admin admin] Checking segment: {'id': 'a153d795-6211-46b2-8f0b-7ad2b960789e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:51:39.139338 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25045c7c-200f-430e-9128-4b453061977a admin admin] Network hostable DHCP agents. Network: 0eb7a116-2a77-4328-bf89-9d4de60476a4, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111275) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 02:51:39.143728 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25045c7c-200f-430e-9128-4b453061977a admin admin] Pushing event updated for resources: {'Subnet': ['ID=182bf748-78aa-44a8-ac30-4789f4c617a3,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:51:39.242859 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25045c7c-200f-430e-9128-4b453061977a admin admin] Network 0eb7a116-2a77-4328-bf89-9d4de60476a4 is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111275) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 02:51:39.328776 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-25045c7c-200f-430e-9128-4b453061977a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 0eb7a116-2a77-4328-bf89-9d4de60476a4) {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:51:39.333152 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25045c7c-200f-430e-9128-4b453061977a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:51:39.333770 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-25045c7c-200f-430e-9128-4b453061977a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:39.339158 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d382d226-0528-47dc-8ddd-2733a1b45cfa None None] Network 0eb7a116-2a77-4328-bf89-9d4de60476a4 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:51:39.421737 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-25045c7c-200f-430e-9128-4b453061977a admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.7664621 Aug 24 02:51:39.658340 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc8ebca0a-8efd-5c96-8278-1a4ec08c6f82-0eb7a116-2a77-4328-bf89-9d4de60476a4', 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'fixed_ips': [{'subnet_id': '182bf748-78aa-44a8-ac30-4789f4c617a3'}]}} from dv-cinder-803748-8-iscsi. {{(pid=111277) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Aug 24 02:51:39.659536 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:40.045533 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.db_base_plugin_common [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Allocated IP 172.20.0.2 (0eb7a116-2a77-4328-bf89-9d4de60476a4/182bf748-78aa-44a8-ac30-4789f4c617a3/3ddf9814-b336-4688-8a77-5b5249302d14) {{(pid=111277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:51:40.246006 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Notify callbacks [] for port, precommit_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:40.286607 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Transition to ACTIVE for port object 3ddf9814-b336-4688-8a77-5b5249302d14 will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:51:40.309041 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Transition to ACTIVE for port object 3ddf9814-b336-4688-8a77-5b5249302d14 will not be triggered until provisioned by entity DHCP. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:51:40.393002 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:40.458804 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Network 0eb7a116-2a77-4328-bf89-9d4de60476a4 is already hosted by enough agents. {{(pid=111277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:51:40.463775 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.base_scheduler [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Resources bound (agent type, host, resource id): {{(pid=111277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:51:40.478644 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Received port after_create {{(pid=111277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:51:40.481687 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Pushing event updated for resources: {'Port': ['ID=3ddf9814-b336-4688-8a77-5b5249302d14,revision_number=1']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:51:40.512341 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:40.512716 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:40.513059 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:40.513390 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:40.513748 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:40.514080 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:40.514405 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:40.514728 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:40.515065 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:40.515402 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:40.515706 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:40.516023 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Tracked resource versions report: Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: pushed versions: Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: { 'AddressGroup': {'1.2'}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'ConntrackHelper': {'1.0'}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Log': {'1.0'}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Network': {'1.1'}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Port': {'1.7'}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'PortForwarding': {'1.2'}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'QosPolicy': {'1.9'}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'SecurityGroup': {'1.4'}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'SecurityGroupRule': {'1.2'}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'SubPort': {'1.0'}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Subnet': {'1.1'}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Trunk': {'1.1'}} Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: consumer versions: Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: { DHCP agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: L3 agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: Metadata agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: Metering agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: Open vSwitch agent@dv-cinder-803748-8-iscsi: { 'AddressGroup': '1.2', Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'ConntrackHelper': '1.0', Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Log': '1.0', Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Network': '1.1', Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Port': '1.7', Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'PortForwarding': '1.2', Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'QosPolicy': '1.9', Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'SecurityGroup': '1.4', Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'SecurityGroupRule': '1.2', Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'SubPort': '1.0', Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Subnet': '1.1', Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Trunk': '1.1'}} Aug 24 02:51:40.517089 dv-cinder-803748-8-iscsi neutron-server[111277]: {{(pid=111277) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Aug 24 02:51:40.565569 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Attempting to bind port 3ddf9814-b336-4688-8a77-5b5249302d14 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:51:40.565922 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Attempting to bind port 3ddf9814-b336-4688-8a77-5b5249302d14 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': 'a153d795-6211-46b2-8f0b-7ad2b960789e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:51:40.566346 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Attempting to bind port 3ddf9814-b336-4688-8a77-5b5249302d14 on network 0eb7a116-2a77-4328-bf89-9d4de60476a4 {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:51:40.571419 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 51, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:51:40.571815 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Checking segment: {'id': 'a153d795-6211-46b2-8f0b-7ad2b960789e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:51:40.572260 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:40.572642 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Bound using segment: {'id': 'a153d795-6211-46b2-8f0b-7ad2b960789e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:51:40.573092 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Bound port: 3ddf9814-b336-4688-8a77-5b5249302d14, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a153d795-6211-46b2-8f0b-7ad2b960789e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:51:40.573515 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:40.635464 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] For port 3ddf9814-b336-4688-8a77-5b5249302d14, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:51:40.640074 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] For port 3ddf9814-b336-4688-8a77-5b5249302d14, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=3ddf9814-b336-4688-8a77-5b5249302d14,segment=NetworkSegment(a153d795-6211-46b2-8f0b-7ad2b960789e),segment_id=a153d795-6211-46b2-8f0b-7ad2b960789e)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:51:40.684455 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:40.750848 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eba71afb-de95-4fc7-99aa-45717e97de81 None None] Pushing event updated for resources: {'Port': ['ID=3ddf9814-b336-4688-8a77-5b5249302d14,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:51:41.814953 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 57538) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:51:42.143859 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [None req-c008bc75-7824-46a9-986f-6f144af16955 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=111275) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Aug 24 02:51:42.144848 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-c008bc75-7824-46a9-986f-6f144af16955 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3289540 Aug 24 02:51:44.522964 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 57546) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:51:44.837015 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [None req-127c71b5-00ce-4a71-a02e-5f26da321ffe admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=111275) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Aug 24 02:51:44.838131 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-127c71b5-00ce-4a71-a02e-5f26da321ffe admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3142231 Aug 24 02:51:47.514413 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 57556) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:51:48.019020 dv-cinder-803748-8-iscsi neutron-server[111276]: WARNING oslo_policy.policy [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Aug 24 02:51:48.019680 dv-cinder-803748-8-iscsi neutron-server[111276]: WARNING oslo_policy.policy [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Aug 24 02:51:48.238686 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] Request body: {'router': {'name': 'router1', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'admin_state_up': True}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:51:48.302774 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.policy [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=111276) register_rules /opt/stack/neutron/neutron/policy.py:73}} Aug 24 02:51:48.348092 dv-cinder-803748-8-iscsi neutron-server[111276]: WARNING oslo_policy.policy [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Aug 24 02:51:48.348473 dv-cinder-803748-8-iscsi neutron-server[111276]: WARNING oslo_policy.policy [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Aug 24 02:51:48.357383 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.quota [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] Loaded quota_driver: . Aug 24 02:51:48.518463 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-560365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32717'] for router, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:48.520430 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-560249', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-569518', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-437890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32692'] for router, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:48.535064 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 3ddf9814-b336-4688-8a77-5b5249302d14 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:51:48.690160 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:48.700873 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 3ddf9814-b336-4688-8a77-5b5249302d14 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:51:48.742472 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-560242', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-569595'] for router, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:48.820267 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] Notify callbacks [] for router, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:48.821486 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-8f5f4674-e14c-4ddd-aa8b-27e851fb895e admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 1.3061171 Aug 24 02:51:49.151169 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81f52dc2-1716-46ce-8a79-6f9f86a8ec43 None None] Network 0eb7a116-2a77-4328-bf89-9d4de60476a4 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:51:49.266871 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-3fabdf80-cc31-49ee-99dd-42b5cad2ea8f None None] Provisioning for port 3ddf9814-b336-4688-8a77-5b5249302d14 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:51:49.274080 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-3fabdf80-cc31-49ee-99dd-42b5cad2ea8f None None] Provisioning complete for port 3ddf9814-b336-4688-8a77-5b5249302d14 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:51:49.274466 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-3fabdf80-cc31-49ee-99dd-42b5cad2ea8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:49.421481 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-3fabdf80-cc31-49ee-99dd-42b5cad2ea8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:49.456514 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-3fabdf80-cc31-49ee-99dd-42b5cad2ea8f None None] For port 3ddf9814-b336-4688-8a77-5b5249302d14, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=3ddf9814-b336-4688-8a77-5b5249302d14,segment=NetworkSegment(a153d795-6211-46b2-8f0b-7ad2b960789e),segment_id=a153d795-6211-46b2-8f0b-7ad2b960789e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:51:49.501299 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-3fabdf80-cc31-49ee-99dd-42b5cad2ea8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:49.553284 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fabdf80-cc31-49ee-99dd-42b5cad2ea8f None None] Pushing event updated for resources: {'Port': ['ID=3ddf9814-b336-4688-8a77-5b5249302d14,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:51:49.621462 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-2505bc99-1aad-4025-b773-37e18579b901 None None] Provisioning complete for port 3ddf9814-b336-4688-8a77-5b5249302d14 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:51:49.621873 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-2505bc99-1aad-4025-b773-37e18579b901 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:50.513488 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 3ddf9814-b336-4688-8a77-5b5249302d14 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:51:50.558527 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 3ddf9814-b336-4688-8a77-5b5249302d14 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:51:50.559176 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:51.189892 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 57578) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:51:51.403661 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5ef64969-33fd-41f8-b2a7-33135540ef7a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:51.506564 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [None req-c285d2ca-af1b-4368-aba0-4be49737d1b6 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=111275) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Aug 24 02:51:51.507547 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-c285d2ca-af1b-4368-aba0-4be49737d1b6 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3167422 Aug 24 02:51:53.879291 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 57586) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:51:53.939945 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-ffcf8ce0-d6c9-4ead-b9ad-5e9c1e057f53 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:54.198909 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Request body: {'network': {'provider:network_type': 'flat', 'provider:physical_network': 'physnet1', 'admin_state_up': True, 'name': 'public', 'router:external': True, 'is_default': True}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:51:54.271758 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Made reservation on behalf of f2b64d169f2d47aabdedc5dec52af9a6 for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:51:54.274193 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:54.284972 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:54.306149 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:54.370115 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:54.437117 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:54.452938 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Reserving flat network on physical network physnet1 {{(pid=111275) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Aug 24 02:51:54.469956 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=29987461-ae4c-4b63-b26e-94525b3192e5,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:51:54.475000 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:54.475341 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Added segment 14cb234e-5636-4a14-a6ad-467857ff59ba of type flat for network 63097abe-4b2c-457b-a244-629c1feb1fe5 Aug 24 02:51:54.519202 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:54.637519 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:54.638496 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:51:54.639066 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:54.697841 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] Pushing event updated for resources: {'Network': ['ID=63097abe-4b2c-457b-a244-629c1feb1fe5,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:51:54.707761 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 02:51:54.741148 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-d24100d4-d37d-41fb-bd6d-dcfe5698d799 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.8607757 Aug 24 02:51:55.483244 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:56.889236 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:57.079321 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 57604) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:51:57.252448 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ea7a6dc-b40b-4784-a575-c177619c9c67 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:51:57.253770 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-1ea7a6dc-b40b-4784-a575-c177619c9c67 admin admin] 10.222.0.30 "GET /v2.0/subnets/182bf748-78aa-44a8-ac30-4789f4c617a3 HTTP/1.1" status: 200 len: 849 time: 0.1734929 Aug 24 02:51:57.416050 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-0d69080e-f85a-491d-b27c-272194e992ba admin admin] 10.222.0.30 "GET /v2.0/routers/6f505568-d8bf-4ca1-a93a-8c03fa56f0ef HTTP/1.1" status: 200 len: 704 time: 0.1551399 Aug 24 02:51:57.677875 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:57.971179 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Allocated IP 172.20.0.1 (0eb7a116-2a77-4328-bf89-9d4de60476a4/182bf748-78aa-44a8-ac30-4789f4c617a3/5d289210-23ae-4edb-b645-b4aa3fcb5bc8) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:51:58.126257 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:58.148191 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.provisioning_blocks [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Transition to ACTIVE for port object 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 will not be triggered until provisioned by entity DHCP. {{(pid=111275) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:51:58.351667 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:58.423250 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Network 0eb7a116-2a77-4328-bf89-9d4de60476a4 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:51:58.432430 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:51:58.434973 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:51:58.435608 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-571748'] for router_interface, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:58.462047 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Pushing event updated for resources: {'Port': ['ID=5d289210-23ae-4edb-b645-b4aa3fcb5bc8,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:51:58.654809 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-d6d9b47d-8256-49b9-97cc-ba43850a30d0 None None] Provisioning for port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:51:58.658793 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-d6d9b47d-8256-49b9-97cc-ba43850a30d0 None None] Provisioning complete for port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:51:58.659174 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-d6d9b47d-8256-49b9-97cc-ba43850a30d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:58.681119 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:58.693284 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-d6d9b47d-8256-49b9-97cc-ba43850a30d0 None None] Port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 02:51:58.884645 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Notify callbacks [] for port, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:58.951656 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:58.952373 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-748278', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-571822'] for router_interface, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:59.030389 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Pushing event updated for resources: {'Port': ['ID=5d289210-23ae-4edb-b645-b4aa3fcb5bc8,revision_number=2']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:51:59.074965 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Network 0eb7a116-2a77-4328-bf89-9d4de60476a4 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:51:59.076211 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:51:59.300170 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Router 6f505568-d8bf-4ca1-a93a-8c03fa56f0ef is scheduled to L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 with binding_index 1 {{(pid=111275) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Aug 24 02:51:59.314451 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-db490835-9ae3-449c-9255-69818bc7d47e None None] Provisioning complete for port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:51:59.314827 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-db490835-9ae3-449c-9255-69818bc7d47e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:51:59.351523 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-db490835-9ae3-449c-9255-69818bc7d47e None None] Port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 02:51:59.390855 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 02:51:59.396381 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-22414448-b795-434f-8cd0-f369a5f72794 admin admin] 10.222.0.30 "PUT /v2.0/routers/6f505568-d8bf-4ca1-a93a-8c03fa56f0ef/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.9749455 Aug 24 02:51:59.413659 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Sync routers for ids ['6f505568-d8bf-4ca1-a93a-8c03fa56f0ef'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 02:51:59.424993 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Routers {'6f505568-d8bf-4ca1-a93a-8c03fa56f0ef'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:51:59.425904 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:51:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['6f505568-d8bf-4ca1-a93a-8c03fa56f0ef'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:51:59.608940 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Set router 6f505568-d8bf-4ca1-a93a-8c03fa56f0ef gateway port host: None {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 02:52:00.032567 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'name': 'router1', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:51:48Z', 'updated_at': '2021-08-24T02:51:58Z', 'revision_number': 2, 'project_id': '9f92985399604c9db21b1697c9d19390', 'gw_port_host': None, '_interfaces': [{'id': '5d289210-23ae-4edb-b645-b4aa3fcb5bc8', 'name': '', 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'mac_address': 'fa:16:3e:86:65:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '182bf748-78aa-44a8-ac30-4789f4c617a3', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:51:57Z', 'updated_at': '2021-08-24T02:51:58Z', 'revision_number': 2, 'project_id': '9f92985399604c9db21b1697c9d19390', 'subnets': [{'id': '182bf748-78aa-44a8-ac30-4789f4c617a3', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1cf8c3d6-cdef-49e4-a7c1-8fbb4ce3a43d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:52:00.084798 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Checking router: 6f505568-d8bf-4ca1-a93a-8c03fa56f0ef for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 02:52:00.085167 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Updating router 6f505568-d8bf-4ca1-a93a-8c03fa56f0ef port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 binding host dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 02:52:00.133066 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:00.639409 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Notify callbacks [] for port, precommit_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:00.657080 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.provisioning_blocks [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Transition to ACTIVE for port object 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 will not be triggered until provisioned by entity L2. {{(pid=111278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:52:00.734758 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:00.883832 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Pushing event updated for resources: {'Port': ['ID=5d289210-23ae-4edb-b645-b4aa3fcb5bc8,revision_number=3']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:52:00.902436 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:52:00.902814 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:52:00.903162 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:52:00.903502 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:52:00.903840 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:52:00.904173 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:52:00.904508 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:52:00.904840 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:52:00.905183 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:52:00.905512 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:52:00.905861 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:52:00.906187 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Tracked resource versions report: Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: pushed versions: Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: { 'AddressGroup': {'1.2'}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'ConntrackHelper': {'1.0'}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Log': {'1.0'}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Network': {'1.1'}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Port': {'1.7'}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'PortForwarding': {'1.2'}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'QosPolicy': {'1.9'}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'SecurityGroup': {'1.4'}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'SecurityGroupRule': {'1.2'}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'SubPort': {'1.0'}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Subnet': {'1.1'}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Trunk': {'1.1'}} Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: consumer versions: Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: { DHCP agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: L3 agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: Metadata agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: Metering agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: Open vSwitch agent@dv-cinder-803748-8-iscsi: { 'AddressGroup': '1.2', Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'ConntrackHelper': '1.0', Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Log': '1.0', Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Network': '1.1', Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Port': '1.7', Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'PortForwarding': '1.2', Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'QosPolicy': '1.9', Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'SecurityGroup': '1.4', Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'SecurityGroupRule': '1.2', Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'SubPort': '1.0', Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Subnet': '1.1', Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Trunk': '1.1'}} Aug 24 02:52:00.907267 dv-cinder-803748-8-iscsi neutron-server[111278]: {{(pid=111278) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Aug 24 02:52:00.912102 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Attempting to bind port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:52:00.912520 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Attempting to bind port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': 'a153d795-6211-46b2-8f0b-7ad2b960789e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4'}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:52:00.912954 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Attempting to bind port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 on network 0eb7a116-2a77-4328-bf89-9d4de60476a4 {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:52:00.918375 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 51, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:52:00.918788 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Checking segment: {'id': 'a153d795-6211-46b2-8f0b-7ad2b960789e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:52:00.919252 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:00.919642 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Bound using segment: {'id': 'a153d795-6211-46b2-8f0b-7ad2b960789e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4'} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:52:00.920135 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Bound port: 5d289210-23ae-4edb-b645-b4aa3fcb5bc8, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a153d795-6211-46b2-8f0b-7ad2b960789e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4'}}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:52:00.920531 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:00.986466 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] For port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:52:01.005327 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] For port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=5d289210-23ae-4edb-b645-b4aa3fcb5bc8,segment=NetworkSegment(a153d795-6211-46b2-8f0b-7ad2b960789e),segment_id=a153d795-6211-46b2-8f0b-7ad2b960789e)] {{(pid=111278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:52:01.084423 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:01.143164 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Routers {'6f505568-d8bf-4ca1-a93a-8c03fa56f0ef'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:52:01.143793 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:51:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['6f505568-d8bf-4ca1-a93a-8c03fa56f0ef'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:52:01.147513 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b03d20b8-6e76-42f7-b50b-bddc4f5026dc None None] Pushing event updated for resources: {'Port': ['ID=5d289210-23ae-4edb-b645-b4aa3fcb5bc8,revision_number=4']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:52:01.235753 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] Set router 6f505568-d8bf-4ca1-a93a-8c03fa56f0ef gateway port host: None {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 02:52:01.442387 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'name': 'router1', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:51:48Z', 'updated_at': '2021-08-24T02:51:58Z', 'revision_number': 2, 'project_id': '9f92985399604c9db21b1697c9d19390', 'gw_port_host': None, '_interfaces': [{'id': '5d289210-23ae-4edb-b645-b4aa3fcb5bc8', 'name': '', 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'mac_address': 'fa:16:3e:86:65:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '182bf748-78aa-44a8-ac30-4789f4c617a3', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:51:57Z', 'updated_at': '2021-08-24T02:52:00Z', 'revision_number': 4, 'project_id': '9f92985399604c9db21b1697c9d19390', 'subnets': [{'id': '182bf748-78aa-44a8-ac30-4789f4c617a3', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1cf8c3d6-cdef-49e4-a7c1-8fbb4ce3a43d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:52:01.467081 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83dedc30-b32b-40ba-9dd6-e89a1572e55c None None] The sync data for ids ['6f505568-d8bf-4ca1-a93a-8c03fa56f0ef'] in dv-cinder-803748-8-iscsi is: [{'id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'name': 'router1', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:51:48Z', 'updated_at': '2021-08-24T02:51:58Z', 'revision_number': 2, 'project_id': '9f92985399604c9db21b1697c9d19390', 'gw_port_host': None, '_interfaces': [{'id': '5d289210-23ae-4edb-b645-b4aa3fcb5bc8', 'name': '', 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'mac_address': 'fa:16:3e:86:65:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '182bf748-78aa-44a8-ac30-4789f4c617a3', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:51:57Z', 'updated_at': '2021-08-24T02:52:00Z', 'revision_number': 4, 'project_id': '9f92985399604c9db21b1697c9d19390', 'subnets': [{'id': '182bf748-78aa-44a8-ac30-4789f4c617a3', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1cf8c3d6-cdef-49e4-a7c1-8fbb4ce3a43d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 02:52:01.642956 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 57624) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:52:01.753362 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b85b902e-97a1-4fe5-ab12-55318d13db44 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:52:01.754669 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-b85b902e-97a1-4fe5-ab12-55318d13db44 admin admin] 10.222.0.30 "GET /v2.0/networks/63097abe-4b2c-457b-a244-629c1feb1fe5 HTTP/1.1" status: 200 len: 842 time: 0.1106966 Aug 24 02:52:01.764820 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] Request body: {'subnet': {'cidr': '172.27.2.0/24', 'ip_version': 4, 'name': 'public-subnet', 'gateway_ip': '172.27.2.1', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'enable_dhcp': False}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:52:01.883118 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] Made reservation on behalf of f2b64d169f2d47aabdedc5dec52af9a6 for: {'subnet': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:52:01.885417 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] Notify callbacks [] for subnet, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:02.220954 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.objects.ports [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=111275) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Aug 24 02:52:02.221291 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for subnet, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:02.273862 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] Pushing event updated for resources: {'Subnet': ['ID=f60a18ba-c7c4-4157-8bcb-1157d1d1b732,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:52:02.283771 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] Checking segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:52:02.284124 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] Network hostable DHCP agents. Network: 63097abe-4b2c-457b-a244-629c1feb1fe5, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111275) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 02:52:02.374354 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111275) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 02:52:02.431229 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 63097abe-4b2c-457b-a244-629c1feb1fe5) {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:52:02.435187 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:52:02.435762 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:02.441230 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d79d1e3f-041e-4bbe-9772-70f27f30fccc None None] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:52:02.501606 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-61e2e9d8-1432-4217-9003-ce0593a5a2ca admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7280879 Aug 24 02:52:02.575071 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ee02850-9edc-418f-beba-a98ea9d5d5a8 None None] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:52:04.778240 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 57632) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:52:04.981323 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-6d6bf6e5-5628-432a-855f-d6f78eec368d admin admin] 10.222.0.30 "GET /v2.0/routers/6f505568-d8bf-4ca1-a93a-8c03fa56f0ef HTTP/1.1" status: 200 len: 710 time: 0.2018878 Aug 24 02:52:05.069622 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-573797e3-29d3-4574-97c1-6d94ef73db0f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:52:05.076631 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-573797e3-29d3-4574-97c1-6d94ef73db0f admin admin] 10.222.0.30 "GET /v2.0/networks/63097abe-4b2c-457b-a244-629c1feb1fe5 HTTP/1.1" status: 200 len: 886 time: 0.0841320 Aug 24 02:52:05.080826 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:52:05.329538 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:05.624731 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:05.701507 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:05.800976 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Allocated IP 172.27.2.148 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/ba66f1f8-76fd-4709-9a59-da3828c23bfb) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:52:05.902177 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:05.996985 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:06.038154 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:52:06.040774 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:52:06.044100 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:52:06.080466 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Pushing event updated for resources: {'Port': ['ID=ba66f1f8-76fd-4709-9a59-da3828c23bfb,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:52:06.381419 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:06.656088 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-569488', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-560235', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-32674'] for router, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:06.659490 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-569595', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-569481', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-569474', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-560228'] for router, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:06.765444 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Router 6f505568-d8bf-4ca1-a93a-8c03fa56f0ef has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 02:52:06.870686 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 02:52:06.874982 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] Notify callbacks [] for router, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:06.876361 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a8bea45c-d189-4a4a-b665-4f90c71fa7d0 admin admin] 10.222.0.30 "PUT /v2.0/routers/6f505568-d8bf-4ca1-a93a-8c03fa56f0ef HTTP/1.1" status: 200 len: 890 time: 1.7989178 Aug 24 02:52:08.133069 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Sync routers for ids ['6f505568-d8bf-4ca1-a93a-8c03fa56f0ef'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 02:52:08.142928 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Routers {'6f505568-d8bf-4ca1-a93a-8c03fa56f0ef'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:52:08.143566 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:51:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['6f505568-d8bf-4ca1-a93a-8c03fa56f0ef'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:52:08.398602 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Set router 6f505568-d8bf-4ca1-a93a-8c03fa56f0ef gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 02:52:08.598842 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:52:08.822898 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:52:08.831444 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:52:08.831819 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:08.858538 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'name': 'router1', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.148'}], 'enable_snat': True}, 'gw_port_id': 'ba66f1f8-76fd-4709-9a59-da3828c23bfb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:51:48Z', 'updated_at': '2021-08-24T02:52:06Z', 'revision_number': 4, 'project_id': '9f92985399604c9db21b1697c9d19390', 'gw_port': {'id': 'ba66f1f8-76fd-4709-9a59-da3828c23bfb', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:58:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:52:05Z', 'updated_at': '2021-08-24T02:52:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '5d289210-23ae-4edb-b645-b4aa3fcb5bc8', 'name': '', 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'mac_address': 'fa:16:3e:86:65:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '182bf748-78aa-44a8-ac30-4789f4c617a3', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:51:57Z', 'updated_at': '2021-08-24T02:52:00Z', 'revision_number': 4, 'project_id': '9f92985399604c9db21b1697c9d19390', 'subnets': [{'id': '182bf748-78aa-44a8-ac30-4789f4c617a3', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1cf8c3d6-cdef-49e4-a7c1-8fbb4ce3a43d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:52:08.913966 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Checking router: 6f505568-d8bf-4ca1-a93a-8c03fa56f0ef for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 02:52:08.914332 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Updating router 6f505568-d8bf-4ca1-a93a-8c03fa56f0ef port ba66f1f8-76fd-4709-9a59-da3828c23bfb binding host dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 02:52:08.966217 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:09.140788 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:09.227955 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=5d289210-23ae-4edb-b645-b4aa3fcb5bc8,segment=NetworkSegment(a153d795-6211-46b2-8f0b-7ad2b960789e),segment_id=a153d795-6211-46b2-8f0b-7ad2b960789e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:52:09.267820 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 57644) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:52:09.313225 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:09.376373 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Notify callbacks [] for port, precommit_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:09.384003 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-653b5b24-0516-4f83-983c-e45fddf86f21 admin admin] 10.222.0.30 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1150780 Aug 24 02:52:09.398426 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Transition to ACTIVE for port object ba66f1f8-76fd-4709-9a59-da3828c23bfb will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:52:09.400417 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=5d289210-23ae-4edb-b645-b4aa3fcb5bc8,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:52:09.482938 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:09.537448 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Attempting to bind port ba66f1f8-76fd-4709-9a59-da3828c23bfb on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:52:09.537853 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Attempting to bind port ba66f1f8-76fd-4709-9a59-da3828c23bfb by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:52:09.538310 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Attempting to bind port ba66f1f8-76fd-4709-9a59-da3828c23bfb on network 63097abe-4b2c-457b-a244-629c1feb1fe5 {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:52:09.540213 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d32e536-0bf9-4d0e-b0f6-8a2787fcb3a6 None None] Pushing event updated for resources: {'Port': ['ID=ba66f1f8-76fd-4709-9a59-da3828c23bfb,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:52:09.545649 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 51, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:52:09.546024 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Checking segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:52:09.546430 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:09.546821 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Bound using segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:52:09.547528 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Bound port: ba66f1f8-76fd-4709-9a59-da3828c23bfb, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:52:09.547651 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:09.601278 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] For port ba66f1f8-76fd-4709-9a59-da3828c23bfb, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:52:09.604407 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] For port ba66f1f8-76fd-4709-9a59-da3828c23bfb, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=ba66f1f8-76fd-4709-9a59-da3828c23bfb,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:52:09.706471 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:09.766173 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Routers {'6f505568-d8bf-4ca1-a93a-8c03fa56f0ef'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:52:09.766806 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:51:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['6f505568-d8bf-4ca1-a93a-8c03fa56f0ef'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:52:09.769804 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d32e536-0bf9-4d0e-b0f6-8a2787fcb3a6 None None] Pushing event updated for resources: {'Port': ['ID=ba66f1f8-76fd-4709-9a59-da3828c23bfb,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:52:09.959505 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] Set router 6f505568-d8bf-4ca1-a93a-8c03fa56f0ef gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 02:52:10.174389 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'name': 'router1', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.148'}], 'enable_snat': True}, 'gw_port_id': 'ba66f1f8-76fd-4709-9a59-da3828c23bfb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:51:48Z', 'updated_at': '2021-08-24T02:52:06Z', 'revision_number': 4, 'project_id': '9f92985399604c9db21b1697c9d19390', 'gw_port': {'id': 'ba66f1f8-76fd-4709-9a59-da3828c23bfb', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:58:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:52:05Z', 'updated_at': '2021-08-24T02:52:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '5d289210-23ae-4edb-b645-b4aa3fcb5bc8', 'name': '', 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'mac_address': 'fa:16:3e:86:65:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '182bf748-78aa-44a8-ac30-4789f4c617a3', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:51:57Z', 'updated_at': '2021-08-24T02:52:09Z', 'revision_number': 5, 'project_id': '9f92985399604c9db21b1697c9d19390', 'subnets': [{'id': '182bf748-78aa-44a8-ac30-4789f4c617a3', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1cf8c3d6-cdef-49e4-a7c1-8fbb4ce3a43d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:52:10.204927 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5013632-08e5-43cd-846a-b1fac122f8ad None None] The sync data for ids ['6f505568-d8bf-4ca1-a93a-8c03fa56f0ef'] in dv-cinder-803748-8-iscsi is: [{'id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'name': 'router1', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.148'}], 'enable_snat': True}, 'gw_port_id': 'ba66f1f8-76fd-4709-9a59-da3828c23bfb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:51:48Z', 'updated_at': '2021-08-24T02:52:06Z', 'revision_number': 4, 'project_id': '9f92985399604c9db21b1697c9d19390', 'gw_port': {'id': 'ba66f1f8-76fd-4709-9a59-da3828c23bfb', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:58:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:52:05Z', 'updated_at': '2021-08-24T02:52:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '5d289210-23ae-4edb-b645-b4aa3fcb5bc8', 'name': '', 'network_id': '0eb7a116-2a77-4328-bf89-9d4de60476a4', 'tenant_id': '9f92985399604c9db21b1697c9d19390', 'mac_address': 'fa:16:3e:86:65:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6f505568-d8bf-4ca1-a93a-8c03fa56f0ef', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '182bf748-78aa-44a8-ac30-4789f4c617a3', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:51:57Z', 'updated_at': '2021-08-24T02:52:09Z', 'revision_number': 5, 'project_id': '9f92985399604c9db21b1697c9d19390', 'subnets': [{'id': '182bf748-78aa-44a8-ac30-4789f4c617a3', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1cf8c3d6-cdef-49e4-a7c1-8fbb4ce3a43d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 02:52:10.626596 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device ba66f1f8-76fd-4709-9a59-da3828c23bfb up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:52:10.740275 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port ba66f1f8-76fd-4709-9a59-da3828c23bfb completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:52:10.744503 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port ba66f1f8-76fd-4709-9a59-da3828c23bfb triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:52:10.744874 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:10.826283 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:10.848691 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port ba66f1f8-76fd-4709-9a59-da3828c23bfb, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=ba66f1f8-76fd-4709-9a59-da3828c23bfb,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:52:10.929120 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:10.929979 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:52:11.009404 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=ba66f1f8-76fd-4709-9a59-da3828c23bfb,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:52:11.022252 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:52:11.022633 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:12.550889 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device ba66f1f8-76fd-4709-9a59-da3828c23bfb up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:52:12.601441 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port ba66f1f8-76fd-4709-9a59-da3828c23bfb triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:52:12.601991 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:18.591413 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 5 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:52:21.362801 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4690c29b-4766-40df-bc1f-fde067058d01 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:23.922342 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-82565866-b377-4847-8804-4ee486c5a260 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:24.350951 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:25.481226 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:26.865785 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:51.373756 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-ee02cf72-7e1b-4549-bc3a-430756dce168 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:53.942594 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-8dc78a8b-4403-4ecd-a16e-da0e3f3f3311 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:54.332124 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:55.496943 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:52:55.590560 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 5 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:52:56.956072 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:21.375392 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-30208bc2-2383-4bd8-9587-7f55bf714177 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:23.920875 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-51a74507-6d50-4b95-8782-6359b85c438e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:24.331032 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:25.507162 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:26.869355 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:32.588759 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 5 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:53:47.505118 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58212) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:53:47.586632 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.pecan_wsgi.hooks.translation [None req-9f65d760-9bff-4d2c-a6fb-4e5781bf58ad admin admin] GET failed (client error): The resource could not be found. Aug 24 02:53:47.587999 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-9f65d760-9bff-4d2c-a6fb-4e5781bf58ad admin admin] 10.222.0.30 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0819378 Aug 24 02:53:47.783851 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8853064d-8466-4483-a556-ec74044075c5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:53:47.792591 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-8853064d-8466-4483-a556-ec74044075c5 admin admin] 10.222.0.30 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1931233 Aug 24 02:53:49.922727 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58222) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:53:50.050333 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5969e02-c80c-4e6a-8f37-c873ea3d44e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:53:50.051657 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-e5969e02-c80c-4e6a-8f37-c873ea3d44e0 admin admin] 10.222.0.30 "GET /v2.0/subnets/182bf748-78aa-44a8-ac30-4789f4c617a3 HTTP/1.1" status: 200 len: 849 time: 0.1280639 Aug 24 02:53:50.061429 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:53:50.145039 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Notify callbacks [] for subnet, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:50.375157 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8732364332099'] for subnet, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:50.468881 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:53:50.469716 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:50.471079 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] 10.222.0.30 "PUT /v2.0/subnets/182bf748-78aa-44a8-ac30-4789f4c617a3 HTTP/1.1" status: 200 len: 868 time: 0.4134188 Aug 24 02:53:50.483267 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Pushing event updated for resources: {'Subnet': ['ID=182bf748-78aa-44a8-ac30-4789f4c617a3,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:53:50.487775 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b993ad97-5954-41cf-8098-92d9e8586b64 None None] Network 0eb7a116-2a77-4328-bf89-9d4de60476a4 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:53:50.494722 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:53:50.495254 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:53:50.495595 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:53:50.495998 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:53:50.496338 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:53:50.496681 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:53:50.497017 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:53:50.497372 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:53:50.497748 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df12fa2b-4b01-4d3d-b42f-2ada97dc2770 admin admin] Tracked resource versions report: Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: pushed versions: Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: { 'AddressGroup': {'1.2'}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'ConntrackHelper': {'1.0'}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Log': {'1.0'}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Network': {'1.1'}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Port': {'1.7'}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'PortForwarding': {'1.2'}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'QosPolicy': {'1.9'}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'SecurityGroup': {'1.4'}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'SecurityGroupRule': {'1.2'}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'SubPort': {'1.0'}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Subnet': {'1.1'}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Trunk': {'1.1'}} Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: consumer versions: Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: { DHCP agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: L3 agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: Metadata agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: Metering agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: Open vSwitch agent@dv-cinder-803748-8-iscsi: { 'AddressGroup': '1.2', Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'ConntrackHelper': '1.0', Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Log': '1.0', Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Network': '1.1', Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Port': '1.7', Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'PortForwarding': '1.2', Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'QosPolicy': '1.9', Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'SecurityGroup': '1.4', Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'SecurityGroupRule': '1.2', Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'SubPort': '1.0', Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Subnet': '1.1', Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Trunk': '1.1'}} Aug 24 02:53:50.504031 dv-cinder-803748-8-iscsi neutron-server[111276]: {{(pid=111276) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Aug 24 02:53:50.858999 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-c5f94877-b2f5-419d-8227-2fd8511c2763 None None] Provisioning complete for port 3ddf9814-b336-4688-8a77-5b5249302d14 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:53:50.859374 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c5f94877-b2f5-419d-8227-2fd8511c2763 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:50.944258 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-c5f94877-b2f5-419d-8227-2fd8511c2763 None None] Provisioning complete for port 5d289210-23ae-4edb-b645-b4aa3fcb5bc8 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:53:50.944554 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c5f94877-b2f5-419d-8227-2fd8511c2763 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:51.374216 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-25656279-6088-4297-bbde-f9e20cdc8dd9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:52.628390 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58234) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:53:52.831005 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f06a01de-6d7f-47f5-b044-e998ed678c32 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:53:52.831397 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f06a01de-6d7f-47f5-b044-e998ed678c32 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:53:52.832914 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-f06a01de-6d7f-47f5-b044-e998ed678c32 admin admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2035797 Aug 24 02:53:53.910890 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-b5fb683a-725c-43ae-a06d-a308d985891a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:54.382673 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:54.995734 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58242) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:53:55.127185 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0bd44433-e447-4153-b5fe-b1ffcdab7cc8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:53:55.127663 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0bd44433-e447-4153-b5fe-b1ffcdab7cc8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:53:55.129179 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-0bd44433-e447-4153-b5fe-b1ffcdab7cc8 admin admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1325121 Aug 24 02:53:55.685544 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:56.874670 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:53:57.301158 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58250) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:53:57.494583 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29bd54cd-4cfa-4fe2-aff7-b7c3c08bd500 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:53:57.495971 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-29bd54cd-4cfa-4fe2-aff7-b7c3c08bd500 admin admin] 10.222.0.30 "GET /v2.0/networks/0eb7a116-2a77-4328-bf89-9d4de60476a4 HTTP/1.1" status: 200 len: 869 time: 0.1938376 Aug 24 02:53:59.643659 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58258) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:53:59.764611 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a941d36b-f0b2-4628-a119-82b484a4c742 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:53:59.766520 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a941d36b-f0b2-4628-a119-82b484a4c742 admin admin] 10.222.0.30 "GET /v2.0/networks/63097abe-4b2c-457b-a244-629c1feb1fe5 HTTP/1.1" status: 200 len: 886 time: 0.1219270 Aug 24 02:54:01.932380 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58268) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:54:02.056880 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21f94443-f96d-4440-988b-ffce9b9e5fca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:54:02.057337 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21f94443-f96d-4440-988b-ffce9b9e5fca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:54:02.058875 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-21f94443-f96d-4440-988b-ffce9b9e5fca admin admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1255536 Aug 24 02:54:04.181201 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58276) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:54:04.270659 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a5b5ba5-4e22-451a-80ea-afd54513aeb3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:54:04.271117 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a5b5ba5-4e22-451a-80ea-afd54513aeb3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:54:04.272584 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-0a5b5ba5-4e22-451a-80ea-afd54513aeb3 admin admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0904107 Aug 24 02:54:06.440599 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58284) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:54:06.533215 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0266bd2-cad8-4c64-b6d5-5ec9beff1ccf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:54:06.534554 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-f0266bd2-cad8-4c64-b6d5-5ec9beff1ccf admin admin] 10.222.0.30 "GET /v2.0/subnets/182bf748-78aa-44a8-ac30-4789f4c617a3 HTTP/1.1" status: 200 len: 868 time: 0.0930462 Aug 24 02:54:08.710967 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58292) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:54:08.797508 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7900f395-eab2-4003-a8e7-e01d668eb6dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:54:08.798871 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-7900f395-eab2-4003-a8e7-e01d668eb6dc admin admin] 10.222.0.30 "GET /v2.0/subnets/f60a18ba-c7c4-4157-8bcb-1157d1d1b732 HTTP/1.1" status: 200 len: 816 time: 0.0869255 Aug 24 02:54:09.586971 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 5 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:54:21.416445 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-008d5f59-8943-465a-b024-3644190dd37f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:23.944300 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9d559757-1283-4112-aa7b-a8ca0754e081 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:24.330652 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:25.520871 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:26.869636 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:32.572449 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58348) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:54:32.620596 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [None req-e54a186d-97d4-4504-b3f3-1dcc87a0e2a9 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=111276) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Aug 24 02:54:32.621594 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-e54a186d-97d4-4504-b3f3-1dcc87a0e2a9 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0482078 Aug 24 02:54:34.922584 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58356) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:54:34.983585 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.pecan_wsgi.hooks.translation [None req-dc915ae2-8cd9-49cf-9812-7b5cacdac388 admin admin] GET failed (client error): The resource could not be found. Aug 24 02:54:34.984809 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-dc915ae2-8cd9-49cf-9812-7b5cacdac388 admin admin] 10.222.0.30 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0612853 Aug 24 02:54:35.127665 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b2497ee-c505-4124-92bf-5475ab8caa01 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:54:35.129057 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-2b2497ee-c505-4124-92bf-5475ab8caa01 admin admin] 10.222.0.30 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1399620 Aug 24 02:54:37.307549 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58364) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:54:37.354956 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Request body: {'network': {'name': 'shared', 'shared': True, 'admin_state_up': True}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:54:37.434502 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Made reservation on behalf of f2b64d169f2d47aabdedc5dec52af9a6 for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:54:37.437512 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:37.465227 dv-cinder-803748-8-iscsi neutron-server[111275]: WARNING neutron.services.revisions.revision_plugin [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Could not find related network for resource to bump revision. Aug 24 02:54:37.475726 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] vlan segment allocate from pool success with {'vlan_id': 373, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 02:54:37.483993 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:37.484335 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Added segment 497c966f-80df-41e8-af80-77eb55023bc6 of type vlan for network aaad15bb-180d-4948-a96e-c5575545c7de Aug 24 02:54:37.524270 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:37.617752 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:37.618709 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:54:37.619276 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:37.675926 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Pushing event updated for resources: {'Network': ['ID=aaad15bb-180d-4948-a96e-c5575545c7de,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:54:37.682418 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:37.682769 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:37.683108 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:37.683471 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:37.683797 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:37.684122 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:37.684445 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:37.685412 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:37.685847 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:37.688159 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:37.688159 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:37.688159 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:37.697595 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network aaad15bb-180d-4948-a96e-c5575545c7de details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 02:54:37.736675 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-38d0d55c-a2d2-4c6b-a0a6-cc4c46931664 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4280379 Aug 24 02:54:39.930646 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58372) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:54:39.990836 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.pecan_wsgi.hooks.translation [None req-ae0aa1ca-d310-4b1f-98ab-ee273e24f68a admin admin] GET failed (client error): The resource could not be found. Aug 24 02:54:39.992139 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-ae0aa1ca-d310-4b1f-98ab-ee273e24f68a admin admin] 10.222.0.30 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0605404 Aug 24 02:54:40.062071 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f880d8c5-f6e9-48f9-bdd5-eb114f9b056b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:54:40.063534 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-f880d8c5-f6e9-48f9-bdd5-eb114f9b056b admin admin] 10.222.0.30 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0670574 Aug 24 02:54:40.073598 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-dd83687a-88e8-40b5-a7fd-40e1f7c39578 admin admin] Request body: {'subnet': {'name': 'shared-subnet', 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de', 'cidr': '192.168.233.0/24', 'ip_version': 4, 'description': 'shared-subnet'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:54:40.171704 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd83687a-88e8-40b5-a7fd-40e1f7c39578 admin admin] Made reservation on behalf of f2b64d169f2d47aabdedc5dec52af9a6 for: {'subnet': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:54:40.173855 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dd83687a-88e8-40b5-a7fd-40e1f7c39578 admin admin] Notify callbacks [] for subnet, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:40.389229 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dd83687a-88e8-40b5-a7fd-40e1f7c39578 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for subnet, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:40.442273 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd83687a-88e8-40b5-a7fd-40e1f7c39578 admin admin] Pushing event updated for resources: {'Subnet': ['ID=09b97e47-9929-4642-8f6e-96e83853eb38,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:54:40.450411 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dd83687a-88e8-40b5-a7fd-40e1f7c39578 admin admin] Checking segment: {'id': '497c966f-80df-41e8-af80-77eb55023bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:54:40.450836 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd83687a-88e8-40b5-a7fd-40e1f7c39578 admin admin] Network hostable DHCP agents. Network: aaad15bb-180d-4948-a96e-c5575545c7de, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111275) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 02:54:40.524149 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd83687a-88e8-40b5-a7fd-40e1f7c39578 admin admin] Network aaad15bb-180d-4948-a96e-c5575545c7de is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111275) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 02:54:40.605647 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-dd83687a-88e8-40b5-a7fd-40e1f7c39578 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, aaad15bb-180d-4948-a96e-c5575545c7de) {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:54:40.609828 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd83687a-88e8-40b5-a7fd-40e1f7c39578 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:54:40.610408 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dd83687a-88e8-40b5-a7fd-40e1f7c39578 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:40.614484 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6393d89d-39f7-4c9c-b36e-fa6c936083c2 None None] Network aaad15bb-180d-4948-a96e-c5575545c7de requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:54:40.704435 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-dd83687a-88e8-40b5-a7fd-40e1f7c39578 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6340597 Aug 24 02:54:40.857529 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc8ebca0a-8efd-5c96-8278-1a4ec08c6f82-aaad15bb-180d-4948-a96e-c5575545c7de', 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de', 'tenant_id': 'f2b64d169f2d47aabdedc5dec52af9a6', 'fixed_ips': [{'subnet_id': '09b97e47-9929-4642-8f6e-96e83853eb38'}]}} from dv-cinder-803748-8-iscsi. {{(pid=111277) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Aug 24 02:54:40.858454 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:40.990817 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.db_base_plugin_common [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Allocated IP 192.168.233.2 (aaad15bb-180d-4948-a96e-c5575545c7de/09b97e47-9929-4642-8f6e-96e83853eb38/6c1715a4-e5e2-4939-9d31-261fc6d1e90b) {{(pid=111277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:54:41.134112 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Notify callbacks [] for port, precommit_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:41.142344 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Transition to ACTIVE for port object 6c1715a4-e5e2-4939-9d31-261fc6d1e90b will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:54:41.157971 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Transition to ACTIVE for port object 6c1715a4-e5e2-4939-9d31-261fc6d1e90b will not be triggered until provisioned by entity DHCP. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:54:41.229984 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:41.269452 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Network aaad15bb-180d-4948-a96e-c5575545c7de is already hosted by enough agents. {{(pid=111277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:54:41.277559 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.base_scheduler [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Resources bound (agent type, host, resource id): {{(pid=111277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:54:41.280616 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Received port after_create {{(pid=111277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:54:41.288802 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Pushing event updated for resources: {'Port': ['ID=6c1715a4-e5e2-4939-9d31-261fc6d1e90b,revision_number=1']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:54:41.300271 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:41.300687 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:41.301033 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:41.301371 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:41.301724 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:41.302054 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:41.302407 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:41.302730 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:41.303073 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:41.303398 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:41.303714 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:41.304028 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:54:41.356211 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Attempting to bind port 6c1715a4-e5e2-4939-9d31-261fc6d1e90b on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:54:41.356801 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Attempting to bind port 6c1715a4-e5e2-4939-9d31-261fc6d1e90b by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '497c966f-80df-41e8-af80-77eb55023bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:54:41.357162 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Attempting to bind port 6c1715a4-e5e2-4939-9d31-261fc6d1e90b on network aaad15bb-180d-4948-a96e-c5575545c7de {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:54:41.362286 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 54, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:54:41.362654 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Checking segment: {'id': '497c966f-80df-41e8-af80-77eb55023bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:54:41.363050 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:41.363439 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Bound using segment: {'id': '497c966f-80df-41e8-af80-77eb55023bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:54:41.363925 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Bound port: 6c1715a4-e5e2-4939-9d31-261fc6d1e90b, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '497c966f-80df-41e8-af80-77eb55023bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:54:41.364321 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:41.426772 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] For port 6c1715a4-e5e2-4939-9d31-261fc6d1e90b, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:54:41.429855 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] For port 6c1715a4-e5e2-4939-9d31-261fc6d1e90b, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=6c1715a4-e5e2-4939-9d31-261fc6d1e90b,segment=NetworkSegment(497c966f-80df-41e8-af80-77eb55023bc6),segment_id=497c966f-80df-41e8-af80-77eb55023bc6)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:54:41.543977 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:41.601125 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43e70534-7a7f-43fc-a510-43afe535cbae None None] Pushing event updated for resources: {'Port': ['ID=6c1715a4-e5e2-4939-9d31-261fc6d1e90b,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:54:42.396726 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4541c69a-a39f-48da-bc18-87c022cef770 None None] Network aaad15bb-180d-4948-a96e-c5575545c7de requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:54:42.509281 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-cf9555c1-c0c6-4b47-a58e-58ce6496a7ad None None] Provisioning for port 6c1715a4-e5e2-4939-9d31-261fc6d1e90b completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:54:42.704511 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 6c1715a4-e5e2-4939-9d31-261fc6d1e90b up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:54:42.851668 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 6c1715a4-e5e2-4939-9d31-261fc6d1e90b completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:54:42.856307 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 6c1715a4-e5e2-4939-9d31-261fc6d1e90b triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:54:42.856307 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:42.932184 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:42.965940 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port 6c1715a4-e5e2-4939-9d31-261fc6d1e90b, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=6c1715a4-e5e2-4939-9d31-261fc6d1e90b,segment=NetworkSegment(497c966f-80df-41e8-af80-77eb55023bc6),segment_id=497c966f-80df-41e8-af80-77eb55023bc6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:54:43.017481 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:43.071727 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=6c1715a4-e5e2-4939-9d31-261fc6d1e90b,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:54:44.649166 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 6c1715a4-e5e2-4939-9d31-261fc6d1e90b up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:54:44.698752 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 6c1715a4-e5e2-4939-9d31-261fc6d1e90b triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:54:44.699127 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:46.585886 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 5 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:54:51.387400 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-a3e5fcaf-9d3c-4507-a0c9-6b5485660667 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:53.965465 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-a8d408d8-9c87-481a-a8ba-c290547ac0ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:54.329155 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:55.489659 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:54:56.928671 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:55:21.374712 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-af032538-d045-458f-a7ed-03ca30db5e4e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:55:23.583645 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 5 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:55:23.912503 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eabc7008-a299-4da8-a847-8363ed26a872 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:55:24.362946 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:55:25.540639 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:55:26.889554 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:55:51.362771 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-b4c57817-07cc-4deb-a1f7-25bfcfe41999 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:55:53.917498 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-34aac5d5-4db4-4106-bf77-0081c4d6d4f9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:55:54.328372 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:55:55.482799 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:55:56.882363 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:00.581410 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 5 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:56:04.066849 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58424) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:56:04.073242 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [None req-354fc724-749d-48d4-9d03-6aa7135ce21e tempest-verify_tempest_config-1407658798 tempest-verify_tempest_config-1407658798-project] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=111275) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Aug 24 02:56:04.074502 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-354fc724-749d-48d4-9d03-6aa7135ce21e tempest-verify_tempest_config-1407658798 tempest-verify_tempest_config-1407658798-project] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.0066757 Aug 24 02:56:04.714641 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58442) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:56:04.825093 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:04.935604 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:05.013149 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:05.060646 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=d936d4e744f9469fbb174c209a48584a&name=default HTTP/1.1" status: 200 len: 2975 time: 0.3448856 Aug 24 02:56:05.061470 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20bcc7bc-bf08-4e66-b2d8-470f8421eb69,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:56:05.063307 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58448) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:56:05.068628 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.069002 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.069364 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.069725 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.070063 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.070409 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.070743 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.071090 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.071467 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.071796 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.072969 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.073437 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-754d5175-c533-4447-930b-6fdcf17cf30a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.117279 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:05.138271 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:05.287656 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:05.290147 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:05.291473 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/20bcc7bc-bf08-4e66-b2d8-470f8421eb69 HTTP/1.1" status: 204 len: 168 time: 0.2272079 Aug 24 02:56:05.299102 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=20bcc7bc-bf08-4e66-b2d8-470f8421eb69,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:56:05.306936 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.307307 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.307645 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.307972 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.308294 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.308637 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.308961 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.309295 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.309663 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.309984 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.310299 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:05.310614 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a162477-4568-48fa-9dab-50e1ff055c6a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:56:21.372790 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-f703bd62-5779-433f-80f9-18f06e340ab4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:23.926627 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-70ab86ed-89d3-4a12-91b0-e710a1961530 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:24.395603 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:25.492221 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:26.898019 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:37.579426 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 5 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:56:51.360644 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-997d1551-32f9-4fce-9148-62823173d435 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:53.925766 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-59a1f5c8-4cd1-4781-9d29-bec91a4d7c05 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:54.366503 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:55.503237 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:56:56.909091 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:57:14.577851 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 5 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:57:21.364104 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-f863353a-27f7-4a72-835b-4ce01814cbec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:57:23.948644 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-229812b6-4d92-4a80-80d7-0bf2b22255ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:57:24.336212 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:57:25.507601 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:57:26.936348 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:57:37.643319 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-566067'] for agent, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:57:51.365630 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-a076beef-5858-4f22-98da-4c3527ba04e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:57:51.576629 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:57:52.889028 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58522) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:57:52.990029 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-bac61a0d-6f97-4d49-a383-420ca938ac5c admin admin] 10.222.0.30 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.0995495 Aug 24 02:57:53.924103 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c6ce7fa7-a0e8-4acc-a0a4-251e2873808d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:57:54.324106 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:57:55.174402 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58532) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:57:55.228426 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-b75e7396-3105-422d-8336-18ba75892a5b admin admin] 10.222.0.30 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.0529609 Aug 24 02:57:55.518361 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:57:56.916547 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:58:07.630074 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:58:21.403886 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5828aaab-64b8-48b1-a05d-69692c94f05e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:58:23.934895 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-8993487a-6864-4b8a-9995-3b391e9c00d3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:58:24.332129 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:58:25.523282 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:58:26.923214 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:58:28.576208 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:58:37.606221 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:58:51.365748 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-1b50fa10-85d0-466b-887a-3d30ef3a8e0d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:58:53.919800 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-20882903-b415-4139-b485-77b97d2cdfd1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:58:54.319754 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:58:55.545184 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:58:56.913774 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:05.575891 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:59:07.613307 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:21.391709 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-a32f5a12-ed0c-4f0e-bef7-94790d7e4a62 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:23.458959 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58720) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:23.770829 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1010606050-network', 'tenant_id': '050fc06a8c0745b78a8d3f9a9d88ff3f'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:23.892805 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Made reservation on behalf of 050fc06a8c0745b78a8d3f9a9d88ff3f for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:59:23.895251 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:23.908260 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:23.991589 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:24.064664 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09fe9307-cf76-453f-933b-3d2c3f4e3395 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:24.106893 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:24.132109 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] vlan segment allocate from pool success with {'vlan_id': 367, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 02:59:24.140522 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c193609-dcd3-47f2-8d2d-5b04db402f74,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:24.148846 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:24.149192 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:24.149528 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:24.149890 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:24.150216 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:24.150598 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:24.151507 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:24.151874 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:24.152202 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:24.152528 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:24.152839 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:24.153160 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Tracked resource versions report: Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: pushed versions: Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: { 'AddressGroup': {'1.2'}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'ConntrackHelper': {'1.0'}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Log': {'1.0'}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Network': {'1.1'}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Port': {'1.7'}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'PortForwarding': {'1.2'}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'QosPolicy': {'1.9'}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'SecurityGroup': {'1.4'}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'SecurityGroupRule': {'1.2'}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'SubPort': {'1.0'}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Subnet': {'1.1'}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Trunk': {'1.1'}} Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: consumer versions: Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: { DHCP agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: HyperV agent@hv-cinder-80374: {}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: L3 agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: Metadata agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: Metering agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: Open vSwitch agent@dv-cinder-803748-8-iscsi: { 'AddressGroup': '1.2', Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'ConntrackHelper': '1.0', Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Log': '1.0', Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Network': '1.1', Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Port': '1.7', Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'PortForwarding': '1.2', Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'QosPolicy': '1.9', Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'SecurityGroup': '1.4', Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'SecurityGroupRule': '1.2', Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'SubPort': '1.0', Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Subnet': '1.1', Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: 'Trunk': '1.1'}} Aug 24 02:59:24.154179 dv-cinder-803748-8-iscsi neutron-server[111275]: {{(pid=111275) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Aug 24 02:59:24.159153 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:24.159490 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Added segment 5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6 of type vlan for network 007bf848-97a3-4bd3-bd10-cbdcb8cbf250 Aug 24 02:59:24.199817 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:24.289684 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:24.290709 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:24.291840 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:24.375341 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:24.455796 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] Pushing event updated for resources: {'Network': ['ID=007bf848-97a3-4bd3-bd10-cbdcb8cbf250,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:24.471606 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 007bf848-97a3-4bd3-bd10-cbdcb8cbf250 details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 02:59:24.559562 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-f27a1502-6a73-41bf-a6c6-e84daede1fa2 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.0986207 Aug 24 02:59:24.562352 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58760) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:24.567407 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-ca602d5f-e264-47a1-b6bf-377b1451d922 admin admin] Request body: {'subnet': {'network_id': '007bf848-97a3-4bd3-bd10-cbdcb8cbf250', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1010606050-subnet', 'tenant_id': '050fc06a8c0745b78a8d3f9a9d88ff3f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:24.676222 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca602d5f-e264-47a1-b6bf-377b1451d922 admin admin] Made reservation on behalf of 050fc06a8c0745b78a8d3f9a9d88ff3f for: {'subnet': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:59:24.680133 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ca602d5f-e264-47a1-b6bf-377b1451d922 admin admin] Notify callbacks [] for subnet, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:24.680248 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58770) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:24.710132 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58776) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:24.906983 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ca602d5f-e264-47a1-b6bf-377b1451d922 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for subnet, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:24.961292 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca602d5f-e264-47a1-b6bf-377b1451d922 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d9e864a8-ff3c-45e0-8d7e-5ffa4a457c88,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:24.985658 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca602d5f-e264-47a1-b6bf-377b1451d922 admin admin] Checking segment: {'id': '5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': '007bf848-97a3-4bd3-bd10-cbdcb8cbf250'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:24.985658 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca602d5f-e264-47a1-b6bf-377b1451d922 admin admin] Network hostable DHCP agents. Network: 007bf848-97a3-4bd3-bd10-cbdcb8cbf250, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111275) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 02:59:25.033946 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-420279518-network', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:25.063331 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-585236505-network', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:25.078268 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca602d5f-e264-47a1-b6bf-377b1451d922 admin admin] Network 007bf848-97a3-4bd3-bd10-cbdcb8cbf250 is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111275) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 02:59:25.174636 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Made reservation on behalf of 174aaeccb001400ca9af9cfc9b1b87be for: {'network': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:59:25.177049 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.189200 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.195778 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-ca602d5f-e264-47a1-b6bf-377b1451d922 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 007bf848-97a3-4bd3-bd10-cbdcb8cbf250) {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:25.201954 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca602d5f-e264-47a1-b6bf-377b1451d922 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:25.203687 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ca602d5f-e264-47a1-b6bf-377b1451d922 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.206532 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-661c2eaf-a066-49b5-b43e-793fa89b56c2 None None] Network 007bf848-97a3-4bd3-bd10-cbdcb8cbf250 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:59:25.289828 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Made reservation on behalf of 7e23b688defc49bc8fa4cf796a1bc390 for: {'network': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:59:25.292550 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.302020 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.357755 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-978efc9c-c6fa-4f75-8c48-b59fcd56fe7c None None] Network 007bf848-97a3-4bd3-bd10-cbdcb8cbf250 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:59:25.391010 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-ca602d5f-e264-47a1-b6bf-377b1451d922 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.8275449 Aug 24 02:59:25.476865 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.568539 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.571178 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.599424 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] vlan segment allocate from pool success with {'vlan_id': 382, 'physical_network': 'physnet1'} {{(pid=111276) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 02:59:25.643980 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8732364285462', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.644559 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Unsubscribe: segment precommit_create {{(pid=111276) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Aug 24 02:59:25.645236 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.segments_db [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Added segment ce2978d1-5398-4e68-abb9-9457b1c81992 of type vlan for network 4091852f-86f8-4dac-87af-44624502a74d Aug 24 02:59:25.651988 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:25.735807 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.750103 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:25.750103 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:25.750103 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:25.750103 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:25.750103 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:25.750103 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:25.750874 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:25.750874 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:25.751082 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:25.751404 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:25.751731 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:25.752049 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Tracked resource versions report: Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: pushed versions: Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: { 'AddressGroup': {'1.2'}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'ConntrackHelper': {'1.0'}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Log': {'1.0'}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Network': {'1.1'}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Port': {'1.7'}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'PortForwarding': {'1.2'}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'QosPolicy': {'1.9'}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'SecurityGroup': {'1.4'}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'SecurityGroupRule': {'1.2'}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'SubPort': {'1.0'}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Subnet': {'1.1'}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Trunk': {'1.1'}} Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: consumer versions: Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: { DHCP agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: HyperV agent@hv-cinder-80374: {}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: L3 agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: Metadata agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: Metering agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: Open vSwitch agent@dv-cinder-803748-8-iscsi: { 'AddressGroup': '1.2', Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'ConntrackHelper': '1.0', Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Log': '1.0', Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Network': '1.1', Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Port': '1.7', Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'PortForwarding': '1.2', Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'QosPolicy': '1.9', Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'SecurityGroup': '1.4', Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'SecurityGroupRule': '1.2', Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'SubPort': '1.0', Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Subnet': '1.1', Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: 'Trunk': '1.1'}} Aug 24 02:59:25.753076 dv-cinder-803748-8-iscsi neutron-server[111276]: {{(pid=111276) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Aug 24 02:59:25.816092 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.890844 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.894086 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:25.894086 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:25.931374 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:26.016253 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] Pushing event updated for resources: {'Network': ['ID=4091852f-86f8-4dac-87af-44624502a74d,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:26.021242 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] vlan segment allocate from pool success with {'vlan_id': 355, 'physical_network': 'physnet1'} {{(pid=111276) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 02:59:26.040321 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 4091852f-86f8-4dac-87af-44624502a74d details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 02:59:26.042214 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4150c95-1c17-43af-82c9-d0a877589922,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:26.045985 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:26.046376 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.segments_db [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Added segment 6f363f36-ab44-420b-9a62-ff7330e4d1b0 of type vlan for network f35e751d-f371-4788-abda-6a58b8a779df Aug 24 02:59:26.048544 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-b74ff4d3-440b-4a14-a4a1-8153abdae985 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.3677888 Aug 24 02:59:26.051794 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58838) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:26.057152 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-53128e17-8e94-47a3-9f66-62039c44649c admin admin] Request body: {'subnet': {'network_id': '4091852f-86f8-4dac-87af-44624502a74d', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-420279518-subnet', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:26.094699 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:26.221363 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-53128e17-8e94-47a3-9f66-62039c44649c admin admin] Made reservation on behalf of 174aaeccb001400ca9af9cfc9b1b87be for: {'subnet': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:59:26.221560 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:26.222678 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:26.223258 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:26.224484 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-53128e17-8e94-47a3-9f66-62039c44649c admin admin] Notify callbacks [] for subnet, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:26.337096 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] Pushing event updated for resources: {'Network': ['ID=f35e751d-f371-4788-abda-6a58b8a779df,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:26.350732 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network f35e751d-f371-4788-abda-6a58b8a779df details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 02:59:26.428968 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-d2bbb943-9f74-4d35-9965-9ff8d5933dd9 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 1.7166076 Aug 24 02:59:26.428968 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58864) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:26.435507 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-8635a074-725f-4ded-a954-4de4a898befb admin admin] Request body: {'subnet': {'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-585236505-subnet', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:26.522084 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-53128e17-8e94-47a3-9f66-62039c44649c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for subnet, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:26.546994 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8635a074-725f-4ded-a954-4de4a898befb admin admin] Made reservation on behalf of 7e23b688defc49bc8fa4cf796a1bc390 for: {'subnet': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:59:26.549417 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8635a074-725f-4ded-a954-4de4a898befb admin admin] Notify callbacks [] for subnet, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:26.604552 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53128e17-8e94-47a3-9f66-62039c44649c admin admin] Pushing event updated for resources: {'Subnet': ['ID=4f536c4e-b790-4630-bdc6-867501285c32,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:26.629347 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53128e17-8e94-47a3-9f66-62039c44649c admin admin] Checking segment: {'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:26.630058 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53128e17-8e94-47a3-9f66-62039c44649c admin admin] Network hostable DHCP agents. Network: 4091852f-86f8-4dac-87af-44624502a74d, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111275) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 02:59:26.730606 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53128e17-8e94-47a3-9f66-62039c44649c admin admin] Network 4091852f-86f8-4dac-87af-44624502a74d is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111275) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 02:59:26.787871 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58894) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:26.791780 dv-cinder-803748-8-iscsi neutron-server[111275]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 24 02:59:26.840679 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-53128e17-8e94-47a3-9f66-62039c44649c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 4091852f-86f8-4dac-87af-44624502a74d) {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:26.849452 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5321c23-9e3f-4021-9424-fbb11f4bd747 None None] Network 4091852f-86f8-4dac-87af-44624502a74d requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:59:26.900330 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53128e17-8e94-47a3-9f66-62039c44649c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:26.905788 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-53128e17-8e94-47a3-9f66-62039c44649c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:26.924222 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8635a074-725f-4ded-a954-4de4a898befb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for subnet, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:26.977539 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:27.012667 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8635a074-725f-4ded-a954-4de4a898befb admin admin] Pushing event updated for resources: {'Subnet': ['ID=14102a94-a55b-43e1-a7a9-4210a4c2e2fb,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:27.055093 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8635a074-725f-4ded-a954-4de4a898befb admin admin] Checking segment: {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:27.055655 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8635a074-725f-4ded-a954-4de4a898befb admin admin] Network hostable DHCP agents. Network: f35e751d-f371-4788-abda-6a58b8a779df, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111276) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 02:59:27.075123 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e031879a-572b-4689-b41d-17f0751c848e None None] Network 4091852f-86f8-4dac-87af-44624502a74d requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:59:27.079814 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-53128e17-8e94-47a3-9f66-62039c44649c admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.0267253 Aug 24 02:59:27.082951 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58912) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:27.090414 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-420279518-router', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:27.102429 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d86434ca-f051-4940-8f33-2275483305e7 req-a8225b6b-36fc-4bba-974e-8fbac56af03e tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:27.106035 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-a8225b6b-36fc-4bba-974e-8fbac56af03e tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/networks?id=007bf848-97a3-4bd3-bd10-cbdcb8cbf250 HTTP/1.1" status: 200 len: 812 time: 0.3163569 Aug 24 02:59:27.144762 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8635a074-725f-4ded-a954-4de4a898befb admin admin] Network f35e751d-f371-4788-abda-6a58b8a779df is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111276) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 02:59:27.150841 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-04b708b5-e208-4475-ba6a-9d2aa7e23208 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/quotas/050fc06a8c0745b78a8d3f9a9d88ff3f HTTP/1.1" status: 200 len: 375 time: 0.0231564 Aug 24 02:59:27.216230 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-b9178587-6d08-4b58-acd4-aa8b18829bde tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=050fc06a8c0745b78a8d3f9a9d88ff3f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0644302 Aug 24 02:59:27.227181 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-560365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32717'] for router, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:27.228247 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-560249', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-569518', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-437890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32692'] for router, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:27.263810 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-8635a074-725f-4ded-a954-4de4a898befb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, f35e751d-f371-4788-abda-6a58b8a779df) {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:27.268286 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8635a074-725f-4ded-a954-4de4a898befb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:27.268868 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8635a074-725f-4ded-a954-4de4a898befb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:27.272481 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1549a3d-99c1-4b5b-8399-564603374e78 None None] Network f35e751d-f371-4788-abda-6a58b8a779df requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:59:27.312578 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:27.396944 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-a3b407f5-304c-4fc9-820e-4f353eea88d2 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=111275) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Aug 24 02:59:27.398128 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-a3b407f5-304c-4fc9-820e-4f353eea88d2 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0482924 Aug 24 02:59:27.543106 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-8635a074-725f-4ded-a954-4de4a898befb admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.1122701 Aug 24 02:59:27.547571 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-7b5ae83f-b307-4e6c-93ab-10764b6f36eb service neutron] 10.222.0.30 "GET /v2.0/networks/007bf848-97a3-4bd3-bd10-cbdcb8cbf250?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1424105 Aug 24 02:59:27.548547 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc8ebca0a-8efd-5c96-8278-1a4ec08c6f82-f35e751d-f371-4788-abda-6a58b8a779df', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb'}]}} from dv-cinder-803748-8-iscsi. {{(pid=111277) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Aug 24 02:59:27.550218 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:27.550371 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 58940) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:27.565300 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:27.712376 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:27.741958 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.db_base_plugin_common [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Allocated IP 172.20.0.2 (f35e751d-f371-4788-abda-6a58b8a779df/14102a94-a55b-43e1-a7a9-4210a4c2e2fb/eedba570-33dc-438c-a160-8ad01da54f58) {{(pid=111277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:59:27.760674 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-89523349-203b-47af-89a4-350b87e7562f service neutron] 10.222.0.30 "GET /v2.0/networks/007bf848-97a3-4bd3-bd10-cbdcb8cbf250?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1752360 Aug 24 02:59:27.780338 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-560365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32717'] for router, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:27.781502 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-560249', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-569518', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-437890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32692'] for router, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:27.939715 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:27.970330 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Notify callbacks [] for port, precommit_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:27.984874 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Transition to ACTIVE for port object eedba570-33dc-438c-a160-8ad01da54f58 will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:59:28.008929 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Transition to ACTIVE for port object eedba570-33dc-438c-a160-8ad01da54f58 will not be triggered until provisioned by entity DHCP. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:59:28.113220 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.151934 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.228280 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Network f35e751d-f371-4788-abda-6a58b8a779df is already hosted by enough agents. {{(pid=111277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:59:28.230448 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.233704 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 58982) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:28.243459 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.base_scheduler [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Resources bound (agent type, host, resource id): {{(pid=111277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:28.263067 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Received port after_create {{(pid=111277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:59:28.267776 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Pushing event updated for resources: {'Port': ['ID=eedba570-33dc-438c-a160-8ad01da54f58,revision_number=1']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:28.322324 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:28.322708 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:28.323057 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:28.323423 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:28.330003 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:28.330375 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:28.330719 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:28.331055 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:28.331407 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:28.331740 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:28.332069 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:28.332392 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Tracked resource versions report: Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: pushed versions: Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: { 'AddressGroup': {'1.2'}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'ConntrackHelper': {'1.0'}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Log': {'1.0'}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Network': {'1.1'}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Port': {'1.7'}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'PortForwarding': {'1.2'}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'QosPolicy': {'1.9'}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'SecurityGroup': {'1.4'}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'SecurityGroupRule': {'1.2'}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'SubPort': {'1.0'}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Subnet': {'1.1'}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Trunk': {'1.1'}} Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: consumer versions: Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: { DHCP agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: HyperV agent@hv-cinder-80374: {}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: L3 agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: Metadata agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: Metering agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: Open vSwitch agent@dv-cinder-803748-8-iscsi: { 'AddressGroup': '1.2', Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'ConntrackHelper': '1.0', Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Log': '1.0', Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Network': '1.1', Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Port': '1.7', Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'PortForwarding': '1.2', Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'QosPolicy': '1.9', Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'SecurityGroup': '1.4', Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'SecurityGroupRule': '1.2', Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'SubPort': '1.0', Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Subnet': '1.1', Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: 'Trunk': '1.1'}} Aug 24 02:59:28.333440 dv-cinder-803748-8-iscsi neutron-server[111277]: {{(pid=111277) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Aug 24 02:59:28.392264 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59002) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:28.399136 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Attempting to bind port eedba570-33dc-438c-a160-8ad01da54f58 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:59:28.401877 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Attempting to bind port eedba570-33dc-438c-a160-8ad01da54f58 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:59:28.401877 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Attempting to bind port eedba570-33dc-438c-a160-8ad01da54f58 on network f35e751d-f371-4788-abda-6a58b8a779df {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:28.405282 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 59, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:59:28.405689 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Checking segment: {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:28.406098 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.406491 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Bound using segment: {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:59:28.406959 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Bound port: eedba570-33dc-438c-a160-8ad01da54f58, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:59:28.407366 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.409543 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.464624 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0906f5cc-0da4-4c74-89ef-2c08dbb87dea req-0aa6f563-8e95-4712-b5b4-38a5572cbb35 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 210 time: 0.0586822 Aug 24 02:59:28.504058 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] For port eedba570-33dc-438c-a160-8ad01da54f58, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:59:28.509207 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] For port eedba570-33dc-438c-a160-8ad01da54f58, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=eedba570-33dc-438c-a160-8ad01da54f58,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:59:28.527000 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-07cad8d5-4335-4257-8ade-500c3aeb12d3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.578684 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Allocated IP 172.27.2.160 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/82349f3d-6f0c-480d-9a25-80618ce4f1c3) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:59:28.620576 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.729096 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be2ce939-5dbd-473e-8166-3639d4c20519 None None] Pushing event updated for resources: {'Port': ['ID=eedba570-33dc-438c-a160-8ad01da54f58,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:28.793290 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.820670 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-e5f67ef6-23ba-4214-9bf1-a92ddd3bb531 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.855484 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-07cad8d5-4335-4257-8ade-500c3aeb12d3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.866137 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.891557 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:28.901648 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59016) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:28.930281 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-07cad8d5-4335-4257-8ade-500c3aeb12d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.060755 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07cad8d5-4335-4257-8ade-500c3aeb12d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3bc6fd84-42e7-4803-9a01-1c91b5f02dee,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:29.068488 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-07cad8d5-4335-4257-8ade-500c3aeb12d3 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ee9061cd501d4ea285434195a8245026&name=default HTTP/1.1" status: 200 len: 2975 time: 0.8337703 Aug 24 02:59:29.070936 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59032) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:29.141288 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bf48b160-ae68-4f46-b10f-50965e427414 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.168878 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.201898 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:59:29.233610 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:29.238457 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:59:29.310646 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-506e9c02-35b9-462f-adc3-3f47167f0d5b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.335367 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Allocated IP 172.27.2.152 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/be1edf4f-8cf4-4e5b-81a3-e3658ebfc417) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:59:29.374930 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-e5f67ef6-23ba-4214-9bf1-a92ddd3bb531 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.432932 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-506e9c02-35b9-462f-adc3-3f47167f0d5b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.443244 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Pushing event updated for resources: {'Port': ['ID=82349f3d-6f0c-480d-9a25-80618ce4f1c3,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:29.448892 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.472442 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-e5f67ef6-23ba-4214-9bf1-a92ddd3bb531 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.598608 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-e5f67ef6-23ba-4214-9bf1-a92ddd3bb531 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=fc73b7e88832400a98e948ffd06c30be&name=default HTTP/1.1" status: 200 len: 2975 time: 1.1868525 Aug 24 02:59:29.598608 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5f67ef6-23ba-4214-9bf1-a92ddd3bb531 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bf4866ec-73d7-4872-91ba-844915c773a1,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:29.598608 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59046) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:29.599453 dv-cinder-803748-8-iscsi neutron-server[111276]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 24 02:59:29.600009 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bf48b160-ae68-4f46-b10f-50965e427414 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.600646 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59048) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:29.650054 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.668129 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0119b900-e3ce-4166-a3f4-ab70eee44bd1 req-12cf8522-0d40-4001-bb3e-c098bbada833 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 210 time: 0.0708008 Aug 24 02:59:29.703346 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:59:29.706276 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:29.709995 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:59:29.758569 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Pushing event updated for resources: {'Port': ['ID=be1edf4f-8cf4-4e5b-81a3-e3658ebfc417,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:29.794674 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bf48b160-ae68-4f46-b10f-50965e427414 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.832560 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-506e9c02-35b9-462f-adc3-3f47167f0d5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.834809 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-506e9c02-35b9-462f-adc3-3f47167f0d5b admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:29.835715 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-506e9c02-35b9-462f-adc3-3f47167f0d5b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3bc6fd84-42e7-4803-9a01-1c91b5f02dee HTTP/1.1" status: 204 len: 168 time: 0.7639380 Aug 24 02:59:29.886794 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-bf48b160-ae68-4f46-b10f-50965e427414 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=374c9ffb627b4258a2b71a703cbf052f&name=default HTTP/1.1" status: 200 len: 2975 time: 0.9840729 Aug 24 02:59:29.894709 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59064) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:29.902148 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf48b160-ae68-4f46-b10f-50965e427414 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c8abdd1f-e605-4a7b-bc86-bbaed2fbdc2d,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:29.930088 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-506e9c02-35b9-462f-adc3-3f47167f0d5b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3bc6fd84-42e7-4803-9a01-1c91b5f02dee,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:29.990072 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4fa3149-afab-4987-9c21-a2cd24911381 None None] Network f35e751d-f371-4788-abda-6a58b8a779df requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:59:30.003269 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fbbd4dff-12a2-477d-b4c0-c8818136e3b4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.004230 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-51a3d499-f763-472f-9728-453ebdc277dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.022003 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fbbd4dff-12a2-477d-b4c0-c8818136e3b4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.052424 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-51a3d499-f763-472f-9728-453ebdc277dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.054321 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.188819 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-598fe3f7-eccd-424c-959e-ef98dbe6178e None None] Provisioning for port eedba570-33dc-438c-a160-8ad01da54f58 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:59:30.209026 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.375282 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-51a3d499-f763-472f-9728-453ebdc277dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.380818 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-51a3d499-f763-472f-9728-453ebdc277dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.382729 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-51a3d499-f763-472f-9728-453ebdc277dd admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/bf4866ec-73d7-4872-91ba-844915c773a1 HTTP/1.1" status: 204 len: 168 time: 0.7811623 Aug 24 02:59:30.406299 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fbbd4dff-12a2-477d-b4c0-c8818136e3b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.407861 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a3d499-f763-472f-9728-453ebdc277dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf4866ec-73d7-4872-91ba-844915c773a1,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:30.409085 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fbbd4dff-12a2-477d-b4c0-c8818136e3b4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.410260 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-fbbd4dff-12a2-477d-b4c0-c8818136e3b4 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c8abdd1f-e605-4a7b-bc86-bbaed2fbdc2d HTTP/1.1" status: 204 len: 168 time: 0.5146239 Aug 24 02:59:30.424398 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbbd4dff-12a2-477d-b4c0-c8818136e3b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8abdd1f-e605-4a7b-bc86-bbaed2fbdc2d,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:30.455128 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-560242', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-569595'] for router, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.519863 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-560242', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-569595'] for router, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.592026 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59088) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:30.755457 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb28ba39-e618-4aac-8844-2faab5c87d03 req-3b97bcd1-5985-4a3c-9e70-26908f282b95 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 210 time: 0.0268643 Aug 24 02:59:30.831045 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Router f74a791c-18bb-4c9b-8c5c-f142e02c120a is scheduled to L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 with binding_index 1 {{(pid=111276) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Aug 24 02:59:30.832928 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Router 893a8671-6102-43da-9368-0f66640f4cf7 is scheduled to L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 with binding_index 1 {{(pid=111275) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Aug 24 02:59:30.843461 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device eedba570-33dc-438c-a160-8ad01da54f58 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:59:30.952271 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port eedba570-33dc-438c-a160-8ad01da54f58 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:59:30.960512 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port eedba570-33dc-438c-a160-8ad01da54f58 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:30.960512 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:30.986790 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 02:59:30.991867 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 02:59:30.998044 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Sync routers for ids ['f74a791c-18bb-4c9b-8c5c-f142e02c120a'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 02:59:31.007616 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Routers {'f74a791c-18bb-4c9b-8c5c-f142e02c120a'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:59:31.008101 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:59:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['f74a791c-18bb-4c9b-8c5c-f142e02c120a'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:31.026200 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Sync routers for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 02:59:31.033230 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:59:31.033874 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:59:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:31.121601 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] Notify callbacks [] for router, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.125302 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-d1b5682b-83f1-4879-bd66-7b67aeb35732 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 4.0389087 Aug 24 02:59:31.125655 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59108) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:31.125921 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] Notify callbacks [] for router, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.133087 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59110) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:31.133922 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-fe258e1a-825f-4d5d-8ddb-dc9c2ecab0dd admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 3.5825608 Aug 24 02:59:31.195585 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 02:59:31.203581 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Set router f74a791c-18bb-4c9b-8c5c-f142e02c120a gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 02:59:31.318017 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4be39cbd-31f6-40c3-9219-6638c89e7e69 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.359704 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.416089 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'name': 'tempest-ServerRescueNegativeTestJSON-420279518-router', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160'}], 'enable_snat': True}, 'gw_port_id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:29Z', 'revision_number': 3, 'project_id': '174aaeccb001400ca9af9cfc9b1b87be', 'gw_port': {'id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:69:03:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:28Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:31.425171 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port eedba570-33dc-438c-a160-8ad01da54f58, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=eedba570-33dc-438c-a160-8ad01da54f58,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:31.443954 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Checking router: f74a791c-18bb-4c9b-8c5c-f142e02c120a for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 02:59:31.444556 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Updating router f74a791c-18bb-4c9b-8c5c-f142e02c120a port 82349f3d-6f0c-480d-9a25-80618ce4f1c3 binding host dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 02:59:31.464689 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:29Z', 'revision_number': 3, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:29Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:31.472067 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.542651 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Checking router: 893a8671-6102-43da-9368-0f66640f4cf7 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 02:59:31.544895 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Updating router 893a8671-6102-43da-9368-0f66640f4cf7 port be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 binding host dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 02:59:31.551755 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.603970 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59114) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:31.631391 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2a4184dc-5905-42fb-a2ad-290cc0d820ef admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.637271 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.710748 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=eedba570-33dc-438c-a160-8ad01da54f58,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:31.737521 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4be39cbd-31f6-40c3-9219-6638c89e7e69 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.763949 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59116) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:31.774435 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Notify callbacks [] for port, precommit_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.786802 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.provisioning_blocks [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Transition to ACTIVE for port object 82349f3d-6f0c-480d-9a25-80618ce4f1c3 will not be triggered until provisioned by entity L2. {{(pid=111278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:59:31.787310 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9c8408cd-5e5e-47ab-b2fe-f0c8f6504bbd admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.858115 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.937891 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2a4184dc-5905-42fb-a2ad-290cc0d820ef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.939929 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.db.api [None req-9c8408cd-5e5e-47ab-b2fe-f0c8f6504bbd admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Aug 24 02:59:31.939929 dv-cinder-803748-8-iscsi neutron-server[111275]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Aug 24 02:59:31.939929 dv-cinder-803748-8-iscsi neutron-server[111275]: [parameters: {'project_id_1': 'f658db38a5bc4209813bb6dbb9661eee', 'expiration_1': datetime.datetime(2021, 8, 24, 2, 59, 31, 825787)}] Aug 24 02:59:31.939929 dv-cinder-803748-8-iscsi neutron-server[111275]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=111275) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Aug 24 02:59:31.941891 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG oslo_db.api [None req-9c8408cd-5e5e-47ab-b2fe-f0c8f6504bbd admin admin] Performing DB retry for function neutron.db.securitygroups_db.SecurityGroupDbMixin.create_security_group {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Aug 24 02:59:31.959808 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Attempting to bind port 82349f3d-6f0c-480d-9a25-80618ce4f1c3 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:59:31.960597 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Attempting to bind port 82349f3d-6f0c-480d-9a25-80618ce4f1c3 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:59:31.961239 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Attempting to bind port 82349f3d-6f0c-480d-9a25-80618ce4f1c3 on network 63097abe-4b2c-457b-a244-629c1feb1fe5 {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:31.969488 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4be39cbd-31f6-40c3-9219-6638c89e7e69 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.975273 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 59, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:59:31.977308 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Checking segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:31.979607 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:31.986605 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Bound using segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:59:31.986605 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Bound port: 82349f3d-6f0c-480d-9a25-80618ce4f1c3, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:59:31.986605 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.024993 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a85c328a-c748-4aac-af7a-b5a57e00d4d7 req-f6d6413e-7d25-4f32-aff7-50f96fa82d2f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 210 time: 0.0532942 Aug 24 02:59:32.041150 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] For port 82349f3d-6f0c-480d-9a25-80618ce4f1c3, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:59:32.046776 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] For port 82349f3d-6f0c-480d-9a25-80618ce4f1c3, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=82349f3d-6f0c-480d-9a25-80618ce4f1c3,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:59:32.059117 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2a4184dc-5905-42fb-a2ad-290cc0d820ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.063790 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Pushing event updated for resources: {'Port': ['ID=82349f3d-6f0c-480d-9a25-80618ce4f1c3,revision_number=2']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:32.068195 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:32.068659 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:32.069068 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:32.069468 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:32.069889 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:32.070300 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:32.070692 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:32.071194 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:32.071606 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:32.072019 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:32.072967 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:32.073613 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Tracked resource versions report: Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: pushed versions: Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: { 'AddressGroup': {'1.2'}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'ConntrackHelper': {'1.0'}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Log': {'1.0'}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Network': {'1.1'}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Port': {'1.7'}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'PortForwarding': {'1.2'}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'QosPolicy': {'1.9'}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'SecurityGroup': {'1.4'}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'SecurityGroupRule': {'1.2'}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'SubPort': {'1.0'}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Subnet': {'1.1'}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Trunk': {'1.1'}} Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: consumer versions: Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: { DHCP agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: HyperV agent@hv-cinder-80374: {}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: L3 agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: Metadata agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: Metering agent@dv-cinder-803748-8-iscsi: {}, Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: Open vSwitch agent@dv-cinder-803748-8-iscsi: { 'AddressGroup': '1.2', Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'ConntrackHelper': '1.0', Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Log': '1.0', Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Network': '1.1', Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Port': '1.7', Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'PortForwarding': '1.2', Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'QosPolicy': '1.9', Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'SecurityGroup': '1.4', Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'SecurityGroupRule': '1.2', Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'SubPort': '1.0', Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Subnet': '1.1', Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: 'Trunk': '1.1'}} Aug 24 02:59:32.075385 dv-cinder-803748-8-iscsi neutron-server[111278]: {{(pid=111278) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Aug 24 02:59:32.110027 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-2a4184dc-5905-42fb-a2ad-290cc0d820ef admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6c76254551d14704a622137000ff6c46&name=default HTTP/1.1" status: 200 len: 2975 time: 0.5023825 Aug 24 02:59:32.110674 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59126) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:32.113182 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a4184dc-5905-42fb-a2ad-290cc0d820ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b52169fe-a08f-470d-8d8a-8b8723432432,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:32.152307 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Notify callbacks [] for port, precommit_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.163385 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Transition to ACTIVE for port object be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:59:32.181162 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59128) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:32.192203 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-4be39cbd-31f6-40c3-9219-6638c89e7e69 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2dede8ce443a4675acd8cf3e18868f37&name=default HTTP/1.1" status: 200 len: 2975 time: 1.5988443 Aug 24 02:59:32.193212 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.237502 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Routers {'f74a791c-18bb-4c9b-8c5c-f142e02c120a'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:59:32.237958 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-204819d7-9983-441a-a82d-88b1cbdef89f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.238579 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:59:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['f74a791c-18bb-4c9b-8c5c-f142e02c120a'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:32.249334 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.256061 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4be39cbd-31f6-40c3-9219-6638c89e7e69 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f02f7a65-cc59-43ca-b97e-282943756926,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:32.272160 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-204819d7-9983-441a-a82d-88b1cbdef89f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.285882 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-49903402-9d3d-4180-92af-dd080f3ff85d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.333531 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b829e49-8048-4e82-a137-6beab2986c5b None None] Pushing event updated for resources: {'Port': ['ID=be1edf4f-8cf4-4e5b-81a3-e3658ebfc417,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:32.347531 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Attempting to bind port be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:59:32.348219 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Attempting to bind port be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:59:32.348723 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-49903402-9d3d-4180-92af-dd080f3ff85d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.349980 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Attempting to bind port be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 on network 63097abe-4b2c-457b-a244-629c1feb1fe5 {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:32.356968 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 59, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:59:32.357757 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Checking segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:32.359968 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.360641 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Bound using segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:59:32.361332 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Bound port: be1edf4f-8cf4-4e5b-81a3-e3658ebfc417, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:59:32.361990 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.416453 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25d93799-197b-44b1-a677-2fd02746df8e None None] Pushing event updated for resources: {'Port': ['ID=82349f3d-6f0c-480d-9a25-80618ce4f1c3,revision_number=3']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:32.443040 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9c8408cd-5e5e-47ab-b2fe-f0c8f6504bbd admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.449244 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] For port be1edf4f-8cf4-4e5b-81a3-e3658ebfc417, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:59:32.454083 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] For port be1edf4f-8cf4-4e5b-81a3-e3658ebfc417, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=be1edf4f-8cf4-4e5b-81a3-e3658ebfc417,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:59:32.458799 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-204819d7-9983-441a-a82d-88b1cbdef89f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.461943 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-204819d7-9983-441a-a82d-88b1cbdef89f admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.464254 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-204819d7-9983-441a-a82d-88b1cbdef89f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b52169fe-a08f-470d-8d8a-8b8723432432 HTTP/1.1" status: 204 len: 168 time: 0.3525517 Aug 24 02:59:32.471660 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] Set router f74a791c-18bb-4c9b-8c5c-f142e02c120a gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 02:59:32.477397 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-204819d7-9983-441a-a82d-88b1cbdef89f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b52169fe-a08f-470d-8d8a-8b8723432432,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:32.488727 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-49903402-9d3d-4180-92af-dd080f3ff85d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.492762 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-49903402-9d3d-4180-92af-dd080f3ff85d admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.496108 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-49903402-9d3d-4180-92af-dd080f3ff85d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/f02f7a65-cc59-43ca-b97e-282943756926 HTTP/1.1" status: 204 len: 168 time: 0.3124995 Aug 24 02:59:32.522321 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49903402-9d3d-4180-92af-dd080f3ff85d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f02f7a65-cc59-43ca-b97e-282943756926,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:32.545043 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.548140 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.609889 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.622311 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:59:32.622936 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:59:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:32.667860 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b829e49-8048-4e82-a137-6beab2986c5b None None] Pushing event updated for resources: {'Port': ['ID=be1edf4f-8cf4-4e5b-81a3-e3658ebfc417,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:32.700136 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9c8408cd-5e5e-47ab-b2fe-f0c8f6504bbd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.745994 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 02:59:32.809618 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9c8408cd-5e5e-47ab-b2fe-f0c8f6504bbd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:32.844526 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'name': 'tempest-ServerRescueNegativeTestJSON-420279518-router', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160'}], 'enable_snat': True}, 'gw_port_id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:29Z', 'revision_number': 3, 'project_id': '174aaeccb001400ca9af9cfc9b1b87be', 'gw_port': {'id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:69:03:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:32.886131 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-748223ff-44cc-46fa-a784-49c6690b20b3 None None] The sync data for ids ['f74a791c-18bb-4c9b-8c5c-f142e02c120a'] in dv-cinder-803748-8-iscsi is: [{'id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'name': 'tempest-ServerRescueNegativeTestJSON-420279518-router', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160'}], 'enable_snat': True}, 'gw_port_id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:29Z', 'revision_number': 3, 'project_id': '174aaeccb001400ca9af9cfc9b1b87be', 'gw_port': {'id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:69:03:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 02:59:32.906589 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59144) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:32.914196 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-9c8408cd-5e5e-47ab-b2fe-f0c8f6504bbd admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=f658db38a5bc4209813bb6dbb9661eee&name=default HTTP/1.1" status: 200 len: 2975 time: 1.1489539 Aug 24 02:59:32.925205 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device eedba570-33dc-438c-a160-8ad01da54f58 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:59:32.935030 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Allocated IP 172.20.0.1 (4091852f-86f8-4dac-87af-44624502a74d/4f536c4e-b790-4630-bdc6-867501285c32/a332ba93-3521-4c39-a926-54e86542086b) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:59:32.978974 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.43', 63290) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:32.985946 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c8408cd-5e5e-47ab-b2fe-f0c8f6504bbd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb3c162e-060a-4b16-b3f5-055b43a7ad48,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:33.267187 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d4222f8d-40a0-46de-a6ed-92a22f7dbade admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:33.295703 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port eedba570-33dc-438c-a160-8ad01da54f58 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:33.296288 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:33.297831 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d4222f8d-40a0-46de-a6ed-92a22f7dbade admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:33.396294 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:29Z', 'revision_number': 3, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:33.429337 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d86434ca-f051-4940-8f33-2275483305e7 req-087048fb-ed90-4c53-a513-4703ac9c897e tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:33.430956 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-087048fb-ed90-4c53-a513-4703ac9c897e tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.43 "GET /v2.0/networks?id=007bf848-97a3-4bd3-bd10-cbdcb8cbf250 HTTP/1.1" status: 200 len: 812 time: 0.4110630 Aug 24 02:59:33.450084 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c85613be-2259-43ef-95c1-a64b9920f134 None None] The sync data for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi is: [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:29Z', 'revision_number': 3, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 02:59:33.476995 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a520e438-c280-41ed-a654-7a1244ba6694 req-6873a27a-af16-4dab-9a70-30885cff6639 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 210 time: 0.1716361 Aug 24 02:59:33.517763 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-d86434ca-f051-4940-8f33-2275483305e7 req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Request body: {'port': {'device_id': 'ae754fd3-e7a1-4454-806c-894608de1aaf', 'network_id': '007bf848-97a3-4bd3-bd10-cbdcb8cbf250', 'admin_state_up': True, 'tenant_id': '050fc06a8c0745b78a8d3f9a9d88ff3f'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:33.585566 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Allocated IP 172.20.0.1 (f35e751d-f371-4788-abda-6a58b8a779df/14102a94-a55b-43e1-a7a9-4210a4c2e2fb/fe2b62d4-7d80-4b4b-9feb-2311eacbac90) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:59:33.738609 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:33.770713 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59174) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:33.930897 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d4222f8d-40a0-46de-a6ed-92a22f7dbade admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:33.937870 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d4222f8d-40a0-46de-a6ed-92a22f7dbade admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:33.939080 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-d4222f8d-40a0-46de-a6ed-92a22f7dbade admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/eb3c162e-060a-4b16-b3f5-055b43a7ad48 HTTP/1.1" status: 204 len: 168 time: 1.0303309 Aug 24 02:59:33.980709 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4222f8d-40a0-46de-a6ed-92a22f7dbade admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb3c162e-060a-4b16-b3f5-055b43a7ad48,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:34.036635 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:34.060617 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:34.089355 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Transition to ACTIVE for port object fe2b62d4-7d80-4b4b-9feb-2311eacbac90 will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:59:34.119181 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Network 4091852f-86f8-4dac-87af-44624502a74d is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:59:34.133126 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:34.146636 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:59:34.147163 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-571748'] for router_interface, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:34.158825 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2aec20d3-3d18-4aa3-a9d3-d24ad208ae32 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:34.232825 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d86434ca-f051-4940-8f33-2275483305e7 req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Made reservation on behalf of 050fc06a8c0745b78a8d3f9a9d88ff3f for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:59:34.238676 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-d86434ca-f051-4940-8f33-2275483305e7 req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:34.304463 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2aec20d3-3d18-4aa3-a9d3-d24ad208ae32 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:34.338703 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Pushing event updated for resources: {'Port': ['ID=a332ba93-3521-4c39-a926-54e86542086b,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:34.430087 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2aec20d3-3d18-4aa3-a9d3-d24ad208ae32 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:34.496665 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-2aec20d3-3d18-4aa3-a9d3-d24ad208ae32 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=3573ea8bc14446239d3d8fd87d6b96b2&name=default HTTP/1.1" status: 200 len: 2975 time: 0.7246616 Aug 24 02:59:34.498227 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aec20d3-3d18-4aa3-a9d3-d24ad208ae32 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5f29c1b-ab7d-4acc-a776-82b06cd225ac,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:34.520046 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59204) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:34.696216 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-85b4413a-ec88-41be-a230-ebf3de2f8616 req-217f55d3-f770-4973-8db3-57bc6c9c5541 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 210 time: 0.0700707 Aug 24 02:59:34.696216 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cf380ad4-7002-4a67-bf01-ea0bcf8a7500 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:34.740352 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cf380ad4-7002-4a67-bf01-ea0bcf8a7500 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:34.882870 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:34.894823 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cf380ad4-7002-4a67-bf01-ea0bcf8a7500 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:34.897603 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cf380ad4-7002-4a67-bf01-ea0bcf8a7500 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:34.899290 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-cf380ad4-7002-4a67-bf01-ea0bcf8a7500 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b5f29c1b-ab7d-4acc-a776-82b06cd225ac HTTP/1.1" status: 204 len: 168 time: 0.3780653 Aug 24 02:59:34.910773 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf380ad4-7002-4a67-bf01-ea0bcf8a7500 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5f29c1b-ab7d-4acc-a776-82b06cd225ac,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:34.930745 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-d86434ca-f051-4940-8f33-2275483305e7 req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Allocated IP 172.20.0.12 (007bf848-97a3-4bd3-bd10-cbdcb8cbf250/d9e864a8-ff3c-45e0-8d7e-5ffa4a457c88/39c14867-cd45-4087-ae6b-c6c669cf7402) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:59:34.943483 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Network f35e751d-f371-4788-abda-6a58b8a779df is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:59:34.947047 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 82349f3d-6f0c-480d-9a25-80618ce4f1c3 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:59:34.949155 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:34.951579 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:59:34.952248 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-571748'] for router_interface, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:35.083374 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 82349f3d-6f0c-480d-9a25-80618ce4f1c3 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:59:35.090732 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 82349f3d-6f0c-480d-9a25-80618ce4f1c3 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:35.094508 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:35.095160 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Pushing event updated for resources: {'Port': ['ID=fe2b62d4-7d80-4b4b-9feb-2311eacbac90,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:35.102794 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:35.299991 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:35.367605 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port 82349f3d-6f0c-480d-9a25-80618ce4f1c3, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=82349f3d-6f0c-480d-9a25-80618ce4f1c3,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:35.476880 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-d86434ca-f051-4940-8f33-2275483305e7 req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:35.496483 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:35.497336 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:59:35.499151 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-ce27dfdf-db64-4dda-8531-d3eb360ab2bc None None] Provisioning for port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:59:35.596087 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:35.750064 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=82349f3d-6f0c-480d-9a25-80618ce4f1c3,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:35.767703 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-ce27dfdf-db64-4dda-8531-d3eb360ab2bc None None] Provisioning complete for port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:35.770673 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-ce27dfdf-db64-4dda-8531-d3eb360ab2bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:35.858985 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-ce27dfdf-db64-4dda-8531-d3eb360ab2bc None None] Port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 02:59:35.929224 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-d86434ca-f051-4940-8f33-2275483305e7 req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:36.165861 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:36.178868 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:59:36.184833 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:36.208443 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:36.324312 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1fcb746-faae-4b17-8b99-bb85210a788c req-54d5a47e-12eb-41bd-aaa9-09bb5d3d3029 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:36.325903 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b1fcb746-faae-4b17-8b99-bb85210a788c req-54d5a47e-12eb-41bd-aaa9-09bb5d3d3029 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 932 time: 0.4684689 Aug 24 02:59:36.334818 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:36.344171 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d86434ca-f051-4940-8f33-2275483305e7 req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Network 007bf848-97a3-4bd3-bd10-cbdcb8cbf250 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:59:36.348286 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Pushing event updated for resources: {'Port': ['ID=39c14867-cd45-4087-ae6b-c6c669cf7402,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:36.368382 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-d86434ca-f051-4940-8f33-2275483305e7 req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:36.370569 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port be1edf4f-8cf4-4e5b-81a3-e3658ebfc417, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=be1edf4f-8cf4-4e5b-81a3-e3658ebfc417,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:36.379655 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-d86434ca-f051-4940-8f33-2275483305e7 req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:59:36.386885 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d86434ca-f051-4940-8f33-2275483305e7 req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:36.387729 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-d86434ca-f051-4940-8f33-2275483305e7 req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:36.444241 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:36.451688 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b1fcb746-faae-4b17-8b99-bb85210a788c req-0c744f1a-d6fb-426d-a9e1-f20282a14f54 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0926669 Aug 24 02:59:36.509897 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:36.511021 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-748278', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-571822'] for router_interface, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:36.644092 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:36.669270 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:36.669801 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-748278', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-571822'] for router_interface, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:36.671957 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Pushing event updated for resources: {'Port': ['ID=a332ba93-3521-4c39-a926-54e86542086b,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:36.710005 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-c2f8c85e-9b28-408e-9ff0-5ee5bade10d2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.1677632 Aug 24 02:59:36.711513 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=be1edf4f-8cf4-4e5b-81a3-e3658ebfc417,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:36.829300 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Pushing event updated for resources: {'Port': ['ID=fe2b62d4-7d80-4b4b-9feb-2311eacbac90,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:36.845236 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Network 4091852f-86f8-4dac-87af-44624502a74d is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:59:36.854418 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:36.895329 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 82349f3d-6f0c-480d-9a25-80618ce4f1c3 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:59:36.925719 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Network f35e751d-f371-4788-abda-6a58b8a779df is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:59:36.928626 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:36.997534 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 82349f3d-6f0c-480d-9a25-80618ce4f1c3 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:36.997534 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:37.050385 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59254) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:37.080084 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-559a5004-0d15-4862-83a4-fc2943683380 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:37.270803 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:59:37.339151 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Router f74a791c-18bb-4c9b-8c5c-f142e02c120a has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 02:59:37.342299 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-559a5004-0d15-4862-83a4-fc2943683380 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:37.382222 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:37.382222 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:37.458880 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-9bb8ba41-d489-4de3-8490-9f456ed19ad8 None None] Provisioning complete for port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:37.459237 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9bb8ba41-d489-4de3-8490-9f456ed19ad8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:37.484722 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Router 893a8671-6102-43da-9368-0f66640f4cf7 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 02:59:38.247738 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-559a5004-0d15-4862-83a4-fc2943683380 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:38.249829 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-9bb8ba41-d489-4de3-8490-9f456ed19ad8 None None] Port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 02:59:38.250699 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-559a5004-0d15-4862-83a4-fc2943683380 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6ffb9bae3fd54dcba6233093dbeb29af&name=default HTTP/1.1" status: 200 len: 2978 time: 0.5318434 Aug 24 02:59:38.250699 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59264) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:38.250699 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-559a5004-0d15-4862-83a4-fc2943683380 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e8185942-e990-4313-8e13-eefa39c7a66a,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:38.251617 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 02:59:38.252224 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Sync routers for ids ['f74a791c-18bb-4c9b-8c5c-f142e02c120a'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 02:59:38.252224 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Routers {'f74a791c-18bb-4c9b-8c5c-f142e02c120a'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:59:38.252224 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:59:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['f74a791c-18bb-4c9b-8c5c-f142e02c120a'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:38.265933 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393da54b-e323-421f-98a2-95b7270ed241 req-630cbb30-c638-468c-8f41-91571a746abd tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:38.265933 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-393da54b-e323-421f-98a2-95b7270ed241 req-630cbb30-c638-468c-8f41-91571a746abd tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 932 time: 0.1466818 Aug 24 02:59:38.265933 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-40b15dae-eef4-4e18-a747-29581b4b1911 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:38.266277 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-da236353-9ba1-4633-a9ef-12eee25ae27f admin admin] 10.222.0.30 "PUT /v2.0/routers/f74a791c-18bb-4c9b-8c5c-f142e02c120a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.6084416 Aug 24 02:59:38.266566 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-40b15dae-eef4-4e18-a747-29581b4b1911 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:38.266933 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 02:59:38.267319 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Sync routers for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 02:59:38.267382 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-77a5dabb-0053-446c-b853-a240a79a3306 admin admin] 10.222.0.30 "PUT /v2.0/routers/893a8671-6102-43da-9368-0f66640f4cf7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.6759317 Aug 24 02:59:38.267440 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:59:38.267440 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:59:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:38.267569 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-393da54b-e323-421f-98a2-95b7270ed241 req-5fdd453c-02d4-4036-9c49-166bed5031fe tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0831285 Aug 24 02:59:38.267631 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 02:59:38.267689 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Set router f74a791c-18bb-4c9b-8c5c-f142e02c120a gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 02:59:38.267755 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:38.267831 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-40b15dae-eef4-4e18-a747-29581b4b1911 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:38.267831 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-40b15dae-eef4-4e18-a747-29581b4b1911 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:38.267831 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-40b15dae-eef4-4e18-a747-29581b4b1911 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e8185942-e990-4313-8e13-eefa39c7a66a HTTP/1.1" status: 204 len: 168 time: 0.6145031 Aug 24 02:59:38.267831 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40b15dae-eef4-4e18-a747-29581b4b1911 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8185942-e990-4313-8e13-eefa39c7a66a,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:38.316693 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 2, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:38.354835 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'name': 'tempest-ServerRescueNegativeTestJSON-420279518-router', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160'}], 'enable_snat': True}, 'gw_port_id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:34Z', 'revision_number': 4, 'project_id': '174aaeccb001400ca9af9cfc9b1b87be', 'gw_port': {'id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:69:03:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'a332ba93-3521-4c39-a926-54e86542086b', 'name': '', 'network_id': '4091852f-86f8-4dac-87af-44624502a74d', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'mac_address': 'fa:16:3e:02:db:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '4f536c4e-b790-4630-bdc6-867501285c32', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 2, 'project_id': '174aaeccb001400ca9af9cfc9b1b87be', 'subnets': [{'id': '4f536c4e-b790-4630-bdc6-867501285c32', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:38.356647 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Checking router: 893a8671-6102-43da-9368-0f66640f4cf7 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 02:59:38.357073 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Updating router 893a8671-6102-43da-9368-0f66640f4cf7 port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 binding host dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 02:59:38.393512 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:38.407865 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Checking router: f74a791c-18bb-4c9b-8c5c-f142e02c120a for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 02:59:38.408321 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Updating router f74a791c-18bb-4c9b-8c5c-f142e02c120a port a332ba93-3521-4c39-a926-54e86542086b binding host dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 02:59:38.453633 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:38.850195 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Notify callbacks [] for port, precommit_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:38.868738 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Transition to ACTIVE for port object fe2b62d4-7d80-4b4b-9feb-2311eacbac90 will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:59:38.930903 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Notify callbacks [] for port, precommit_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:38.941515 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.provisioning_blocks [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Transition to ACTIVE for port object a332ba93-3521-4c39-a926-54e86542086b will not be triggered until provisioned by entity L2. {{(pid=111278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:59:38.955391 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:39.020832 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:39.050162 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-223ee893-cf79-4c9f-b0ce-4716d761b5b8 None None] Pushing event updated for resources: {'Port': ['ID=fe2b62d4-7d80-4b4b-9feb-2311eacbac90,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:39.128309 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Attempting to bind port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:59:39.128684 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Attempting to bind port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:59:39.129049 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Attempting to bind port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 on network f35e751d-f371-4788-abda-6a58b8a779df {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:39.156313 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 59, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:59:39.156693 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Checking segment: {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:39.157340 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:39.157530 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Bound using segment: {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:59:39.158011 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Bound port: fe2b62d4-7d80-4b4b-9feb-2311eacbac90, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:59:39.159167 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:39.203245 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Attempting to bind port a332ba93-3521-4c39-a926-54e86542086b on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:59:39.203685 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Attempting to bind port a332ba93-3521-4c39-a926-54e86542086b by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:59:39.204091 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Attempting to bind port a332ba93-3521-4c39-a926-54e86542086b on network 4091852f-86f8-4dac-87af-44624502a74d {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:39.211718 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 59, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:59:39.214070 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Checking segment: {'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:39.214799 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:39.214913 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Bound using segment: {'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:59:39.215381 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Bound port: a332ba93-3521-4c39-a926-54e86542086b, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'}}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:59:39.215748 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:39.303562 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] For port fe2b62d4-7d80-4b4b-9feb-2311eacbac90, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:59:39.307538 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] For port fe2b62d4-7d80-4b4b-9feb-2311eacbac90, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=fe2b62d4-7d80-4b4b-9feb-2311eacbac90,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:59:39.348621 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] For port a332ba93-3521-4c39-a926-54e86542086b, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:59:39.351683 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] For port a332ba93-3521-4c39-a926-54e86542086b, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=a332ba93-3521-4c39-a926-54e86542086b,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:59:39.354352 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-174a3efe-601f-423e-bf51-1dc322200466 None None] Pushing event updated for resources: {'Port': ['ID=a332ba93-3521-4c39-a926-54e86542086b,revision_number=3']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:39.453616 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:39.512657 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:39.576776 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Routers {'f74a791c-18bb-4c9b-8c5c-f142e02c120a'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:59:39.577423 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:59:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['f74a791c-18bb-4c9b-8c5c-f142e02c120a'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:39.643725 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 02:59:39.644557 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:59:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:39.660823 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-223ee893-cf79-4c9f-b0ce-4716d761b5b8 None None] Pushing event updated for resources: {'Port': ['ID=fe2b62d4-7d80-4b4b-9feb-2311eacbac90,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:39.911676 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-174a3efe-601f-423e-bf51-1dc322200466 None None] Pushing event updated for resources: {'Port': ['ID=a332ba93-3521-4c39-a926-54e86542086b,revision_number=4']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:39.945432 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] Set router f74a791c-18bb-4c9b-8c5c-f142e02c120a gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 02:59:39.965879 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 02:59:40.035497 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59322) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:40.043344 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-7e9a2eb0-e3e3-4e96-b742-9ebdbb3118b0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1631115418', 'description': 'tempest-description--1496372762'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:40.260563 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7e9a2eb0-e3e3-4e96-b742-9ebdbb3118b0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:40.291501 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3391f6f-26d4-4ac1-91de-303eb369aa64 req-0629497c-f3c8-46c2-ad6d-4fe6d9877e47 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:40.296909 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d3391f6f-26d4-4ac1-91de-303eb369aa64 req-0629497c-f3c8-46c2-ad6d-4fe6d9877e47 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 932 time: 0.1407158 Aug 24 02:59:40.382775 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d3391f6f-26d4-4ac1-91de-303eb369aa64 req-89babc83-ec4e-4a13-bdfb-994f1aad5c81 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750606 Aug 24 02:59:40.443479 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'name': 'tempest-ServerRescueNegativeTestJSON-420279518-router', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160'}], 'enable_snat': True}, 'gw_port_id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:34Z', 'revision_number': 4, 'project_id': '174aaeccb001400ca9af9cfc9b1b87be', 'gw_port': {'id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:69:03:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'a332ba93-3521-4c39-a926-54e86542086b', 'name': '', 'network_id': '4091852f-86f8-4dac-87af-44624502a74d', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'mac_address': 'fa:16:3e:02:db:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '4f536c4e-b790-4630-bdc6-867501285c32', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:39Z', 'revision_number': 4, 'project_id': '174aaeccb001400ca9af9cfc9b1b87be', 'subnets': [{'id': '4f536c4e-b790-4630-bdc6-867501285c32', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:40.480793 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30997e2a-aed5-4178-b790-01df5f51b2d9 None None] The sync data for ids ['f74a791c-18bb-4c9b-8c5c-f142e02c120a'] in dv-cinder-803748-8-iscsi is: [{'id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'name': 'tempest-ServerRescueNegativeTestJSON-420279518-router', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160'}], 'enable_snat': True}, 'gw_port_id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:34Z', 'revision_number': 4, 'project_id': '174aaeccb001400ca9af9cfc9b1b87be', 'gw_port': {'id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:69:03:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'a332ba93-3521-4c39-a926-54e86542086b', 'name': '', 'network_id': '4091852f-86f8-4dac-87af-44624502a74d', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'mac_address': 'fa:16:3e:02:db:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '4f536c4e-b790-4630-bdc6-867501285c32', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:39Z', 'revision_number': 4, 'project_id': '174aaeccb001400ca9af9cfc9b1b87be', 'subnets': [{'id': '4f536c4e-b790-4630-bdc6-867501285c32', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 02:59:40.556958 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-e1849002-e40b-4c12-a3ee-ec8d7f7ca0dd tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=111276) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Aug 24 02:59:40.558813 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-e1849002-e40b-4c12-a3ee-ec8d7f7ca0dd tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0067062 Aug 24 02:59:40.722262 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:39Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 02:59:40.753118 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04cfbfdc-addc-45ab-b6a7-c9cd60bf19b0 None None] The sync data for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi is: [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:39Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 02:59:40.782112 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-84d60b9a-bd53-4376-8608-641f8946d5ed tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:40.783844 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-84d60b9a-bd53-4376-8608-641f8946d5ed tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/networks?id=4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 200 len: 818 time: 0.4857378 Aug 24 02:59:40.878221 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-29775890-b630-4727-a584-20ad44fce97a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/quotas/174aaeccb001400ca9af9cfc9b1b87be HTTP/1.1" status: 200 len: 375 time: 0.0654819 Aug 24 02:59:41.027425 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device a332ba93-3521-4c39-a926-54e86542086b up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:59:41.142976 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-5f846006-6a13-4bd7-9d99-7e9044388c16 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2638257 Aug 24 02:59:41.230267 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7e9a2eb0-e3e3-4e96-b742-9ebdbb3118b0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:41.282164 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ef961540-ce33-4f62-9e20-21381ed139fb service neutron] 10.222.0.30 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1381671 Aug 24 02:59:41.404508 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-17f85afb-7eaf-425d-b7bf-5755828436b1 service neutron] 10.222.0.30 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1160586 Aug 24 02:59:41.590089 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5389cab-2d30-4f6e-9743-e5575f45bace req-1cf00d8f-82ef-4fac-978f-12c13c4b2cc2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:41.599351 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f5389cab-2d30-4f6e-9743-e5575f45bace req-1cf00d8f-82ef-4fac-978f-12c13c4b2cc2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 932 time: 0.1046050 Aug 24 02:59:41.665166 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f5389cab-2d30-4f6e-9743-e5575f45bace req-1f826586-3ef7-448b-944c-b8f9ff1027a1 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647490 Aug 24 02:59:41.803786 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7e9a2eb0-e3e3-4e96-b742-9ebdbb3118b0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:41.806292 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port a332ba93-3521-4c39-a926-54e86542086b completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:59:41.819073 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port a332ba93-3521-4c39-a926-54e86542086b triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:41.819457 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:41.976912 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e9a2eb0-e3e3-4e96-b742-9ebdbb3118b0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9efe755d-a2a2-41c1-926c-a4d4a12f8864,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:42.000222 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7e9a2eb0-e3e3-4e96-b742-9ebdbb3118b0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:42.012976 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-7e9a2eb0-e3e3-4e96-b742-9ebdbb3118b0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 1.9747455 Aug 24 02:59:42.017028 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59368) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:42.036765 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-a5519fc6-174e-4a79-9b28-2bbbf1604dac tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Request body: {'security_group_rule': {'security_group_id': '9efe755d-a2a2-41c1-926c-a4d4a12f8864', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:42.041064 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:42.096271 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-45de6d9f-719a-4ebd-8a0c-5655c6224b65 req-59bfaf25-3e7d-42a3-bd66-84202aa73f9d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 210 time: 0.1413679 Aug 24 02:59:42.137276 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port a332ba93-3521-4c39-a926-54e86542086b, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=a332ba93-3521-4c39-a926-54e86542086b,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:42.517956 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:42.538492 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a5519fc6-174e-4a79-9b28-2bbbf1604dac tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:42.586759 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=a332ba93-3521-4c39-a926-54e86542086b,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:42.587598 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 02:59:42.670522 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a5519fc6-174e-4a79-9b28-2bbbf1604dac tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:42.869015 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc7c236-3577-477b-be88-7295bcfaebd6 req-835a7213-0e65-4514-a99d-763ae3811c75 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:42.871091 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fcc7c236-3577-477b-be88-7295bcfaebd6 req-835a7213-0e65-4514-a99d-763ae3811c75 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 932 time: 0.0701108 Aug 24 02:59:42.911715 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fcc7c236-3577-477b-be88-7295bcfaebd6 req-25e2ddf1-15be-40a2-a00d-168ac8ead8fa tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0343647 Aug 24 02:59:42.975801 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a5519fc6-174e-4a79-9b28-2bbbf1604dac tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:43.002131 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5519fc6-174e-4a79-9b28-2bbbf1604dac tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7d925f41-a12d-4d21-bfbf-146ec724e874,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:43.010200 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device fe2b62d4-7d80-4b4b-9feb-2311eacbac90 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:59:43.251402 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59422) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:43.279796 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95154752-88cf-4fde-9b49-27ff15f26316 req-72f78866-5eed-4279-9784-eab26cded618 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:43.289693 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-72f78866-5eed-4279-9784-eab26cded618 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/networks?id=4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 200 len: 818 time: 0.1957994 Aug 24 02:59:43.303795 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:59:43.304670 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a5519fc6-174e-4a79-9b28-2bbbf1604dac tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:43.306393 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a5519fc6-174e-4a79-9b28-2bbbf1604dac tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.2768285 Aug 24 02:59:43.309487 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59426) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:43.315454 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:43.315454 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:43.315920 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-c398cb4c-e788-4e89-9242-48a3e321dfcd tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Request body: {'security_group_rule': {'security_group_id': '9efe755d-a2a2-41c1-926c-a4d4a12f8864', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:43.316513 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-190c8465-ae58-4787-b95f-edd98e347687 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/quotas/174aaeccb001400ca9af9cfc9b1b87be HTTP/1.1" status: 200 len: 375 time: 0.0249312 Aug 24 02:59:43.487822 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c398cb4c-e788-4e89-9242-48a3e321dfcd tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:43.541700 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-deb562e4-6580-4070-a2ad-31dd68a323e2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2202556 Aug 24 02:59:43.611457 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:43.630909 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c398cb4c-e788-4e89-9242-48a3e321dfcd tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:43.696171 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0994cb81-af8d-4559-a194-300f0f825667 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:43.766635 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port fe2b62d4-7d80-4b4b-9feb-2311eacbac90, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=fe2b62d4-7d80-4b4b-9feb-2311eacbac90,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:43.811676 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0994cb81-af8d-4559-a194-300f0f825667 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:43.887099 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c398cb4c-e788-4e89-9242-48a3e321dfcd tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:43.906195 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c398cb4c-e788-4e89-9242-48a3e321dfcd tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=83e812b8-0c32-4b1f-9756-94ab73b4234b,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:43.931587 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:43.932883 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device a332ba93-3521-4c39-a926-54e86542086b up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:59:43.943614 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0994cb81-af8d-4559-a194-300f0f825667 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:44.049203 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-0994cb81-af8d-4559-a194-300f0f825667 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=65682909459f4a16bd894fbbc21a1467&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7959285 Aug 24 02:59:44.051559 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c398cb4c-e788-4e89-9242-48a3e321dfcd tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:44.051761 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59446) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:44.055686 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-c398cb4c-e788-4e89-9242-48a3e321dfcd tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7423871 Aug 24 02:59:44.060367 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59448) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:44.066170 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Request body: {'floatingip': {'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:44.119928 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=fe2b62d4-7d80-4b4b-9feb-2311eacbac90,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:44.147053 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0994cb81-af8d-4559-a194-300f0f825667 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4daa8566-6fdc-495f-8848-5ef2af28e058,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:44.154751 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-89971831-0d55-4213-9a8f-edc4fa690e8e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:44.184196 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-89971831-0d55-4213-9a8f-edc4fa690e8e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:44.236077 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port a332ba93-3521-4c39-a926-54e86542086b triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:44.236830 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:44.258112 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b05e67-2946-4174-86c0-5346e719ad39 req-94ca15f3-4fdf-49ef-8dff-cce41b21f7c3 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:44.264341 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a4b05e67-2946-4174-86c0-5346e719ad39 req-94ca15f3-4fdf-49ef-8dff-cce41b21f7c3 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 932 time: 0.1693490 Aug 24 02:59:44.357810 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a4b05e67-2946-4174-86c0-5346e719ad39 req-29200d42-5e61-4a67-8701-a547cb0bc0a9 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636468 Aug 24 02:59:44.495559 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-89971831-0d55-4213-9a8f-edc4fa690e8e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:44.498369 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-89971831-0d55-4213-9a8f-edc4fa690e8e admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:44.502676 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-89971831-0d55-4213-9a8f-edc4fa690e8e admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/4daa8566-6fdc-495f-8848-5ef2af28e058 HTTP/1.1" status: 204 len: 168 time: 0.4468513 Aug 24 02:59:44.502676 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:44.504825 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59460) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:44.544832 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89971831-0d55-4213-9a8f-edc4fa690e8e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4daa8566-6fdc-495f-8848-5ef2af28e058,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:44.692387 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-8047bf75-c097-4430-bdc8-e3a09299fd1b service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=111276) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Aug 24 02:59:44.695025 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-8047bf75-c097-4430-bdc8-e3a09299fd1b service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.2274191 Aug 24 02:59:44.873960 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-50699805-3e66-49ad-9012-54cd4db30bb8 service neutron] 10.222.0.30 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1684031 Aug 24 02:59:44.883266 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device fe2b62d4-7d80-4b4b-9feb-2311eacbac90 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:59:44.887819 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:44.967493 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:44.968124 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:45.163513 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-bef007a5-9817-4d10-bddc-8ef787aebf71 service neutron] 10.222.0.30 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2663801 Aug 24 02:59:45.163513 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Allocated IP 172.27.2.141 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/5a8c0db8-5ba3-46f9-83b2-1e4c5b5e6238) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:59:45.209911 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-37bccffa-4010-45c9-93a4-8dbceeeebf89 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:45.318369 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:45.341070 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-37bccffa-4010-45c9-93a4-8dbceeeebf89 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:45.469549 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fb83f57-5a0f-46b7-ac4b-b6871c8f659f req-e97da576-747b-4ae8-a591-63ab19304eee tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:45.470991 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5fb83f57-5a0f-46b7-ac4b-b6871c8f659f req-e97da576-747b-4ae8-a591-63ab19304eee tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 932 time: 0.0505836 Aug 24 02:59:45.500928 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:45.538666 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-37bccffa-4010-45c9-93a4-8dbceeeebf89 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:45.591287 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-37bccffa-4010-45c9-93a4-8dbceeeebf89 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=174dde5cd85948adab5e5d7365066cb2&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0853243 Aug 24 02:59:45.595444 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37bccffa-4010-45c9-93a4-8dbceeeebf89 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=350ce795-a628-4a24-a5d3-5e19b0c6ea3b,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:45.595444 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59492) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:45.633412 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5fb83f57-5a0f-46b7-ac4b-b6871c8f659f req-0d5cac68-ca74-487d-8485-ee6ec35ad077 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1515772 Aug 24 02:59:45.656606 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event updated for resources: {'Port': ['ID=5a8c0db8-5ba3-46f9-83b2-1e4c5b5e6238,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:45.682655 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:59:45.685197 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:45.688022 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:59:45.698914 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9629fbac-8ebf-43fe-bf2a-f1ee80ddc3ea admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:45.721818 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9629fbac-8ebf-43fe-bf2a-f1ee80ddc3ea admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:45.793550 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d5c9c68d-ef53-44b9-8696-cea18b075bbf req-e003d9a4-833a-426c-9abb-f0240f364b68 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 210 time: 0.1322386 Aug 24 02:59:45.837648 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:45.877601 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9629fbac-8ebf-43fe-bf2a-f1ee80ddc3ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:45.883340 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9629fbac-8ebf-43fe-bf2a-f1ee80ddc3ea admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:45.887324 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-9629fbac-8ebf-43fe-bf2a-f1ee80ddc3ea admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/350ce795-a628-4a24-a5d3-5e19b0c6ea3b HTTP/1.1" status: 204 len: 168 time: 0.2517531 Aug 24 02:59:45.902430 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9629fbac-8ebf-43fe-bf2a-f1ee80ddc3ea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=350ce795-a628-4a24-a5d3-5e19b0c6ea3b,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:46.022900 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:46.205074 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:46.300161 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:46.335450 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Request body: {'port': {'device_id': 'ae754fd3-e7a1-4454-806c-894608de1aaf', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:46.352420 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:46.420597 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event updated for resources: {'Port': ['ID=5a8c0db8-5ba3-46f9-83b2-1e4c5b5e6238,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:46.448200 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:46.574822 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:46.585055 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-ec769a6a-3d55-4b4f-89d3-c13bbf21c017 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.5235362 Aug 24 02:59:46.738163 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59542) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:46.782281 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-80cd6783-9d25-4f81-9b40-12a742ea7509 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:46.836275 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb46981-6694-4fe9-bbef-296a2ce8131d req-74a7facf-abf4-4567-8711-0ff50daf6400 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:46.847897 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fbb46981-6694-4fe9-bbef-296a2ce8131d req-74a7facf-abf4-4567-8711-0ff50daf6400 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 932 time: 0.1240473 Aug 24 02:59:46.929667 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-833ec1b6-a852-4df1-8962-a93d93b7cb47 req-bb0118ef-8810-49fb-975e-ff59c91ffa6c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 210 time: 0.0525701 Aug 24 02:59:46.982036 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fbb46981-6694-4fe9-bbef-296a2ce8131d req-b16cdedc-7371-43ef-8981-a25c318248cf tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1311443 Aug 24 02:59:47.098000 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-80cd6783-9d25-4f81-9b40-12a742ea7509 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:47.160326 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 39c14867-cd45-4087-ae6b-c6c669cf7402 {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 02:59:47.186041 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:47.203199 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-80cd6783-9d25-4f81-9b40-12a742ea7509 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:47.224922 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-d38d96bf-b78e-4003-8812-2dfa73cd434f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1631115418&fields=id&tenant_id=7e23b688defc49bc8fa4cf796a1bc390 HTTP/1.1" status: 200 len: 267 time: 0.0997078 Aug 24 02:59:47.239548 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Transition to ACTIVE for port object 39c14867-cd45-4087-ae6b-c6c669cf7402 will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:59:47.241911 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80cd6783-9d25-4f81-9b40-12a742ea7509 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5489372b-90c9-4f56-9b4d-e8257c7b0392,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:47.260966 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-80cd6783-9d25-4f81-9b40-12a742ea7509 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=f7f57f08a4e74ce390dd7dd0a0f29ee5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5199401 Aug 24 02:59:47.264096 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59586) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:47.350903 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3604e5dd-2ff5-4b00-8f63-d87e1ef9d510 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:47.377838 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3604e5dd-2ff5-4b00-8f63-d87e1ef9d510 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:47.378319 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:47.445774 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.43', 63303) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:47.478959 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Pushing event updated for resources: {'Port': ['ID=39c14867-cd45-4087-ae6b-c6c669cf7402,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:47.546751 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3604e5dd-2ff5-4b00-8f63-d87e1ef9d510 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:47.553461 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3604e5dd-2ff5-4b00-8f63-d87e1ef9d510 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:47.554990 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-3604e5dd-2ff5-4b00-8f63-d87e1ef9d510 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5489372b-90c9-4f56-9b4d-e8257c7b0392 HTTP/1.1" status: 204 len: 168 time: 0.2896063 Aug 24 02:59:47.569477 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Attempting to bind port 39c14867-cd45-4087-ae6b-c6c669cf7402 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:59:47.569888 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Attempting to bind port 39c14867-cd45-4087-ae6b-c6c669cf7402 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': '5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': '007bf848-97a3-4bd3-bd10-cbdcb8cbf250'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:59:47.570304 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Attempting to bind port 39c14867-cd45-4087-ae6b-c6c669cf7402 on network 007bf848-97a3-4bd3-bd10-cbdcb8cbf250 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:47.596928 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3604e5dd-2ff5-4b00-8f63-d87e1ef9d510 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5489372b-90c9-4f56-9b4d-e8257c7b0392,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:47.599287 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-b0d9f7b0-7895-409a-81d2-e7073e4d2981 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:47.604136 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-b0d9f7b0-7895-409a-81d2-e7073e4d2981 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/networks?id=f35e751d-f371-4788-abda-6a58b8a779df HTTP/1.1" status: 200 len: 810 time: 0.3660016 Aug 24 02:59:47.625007 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Port 39c14867-cd45-4087-ae6b-c6c669cf7402 on network 007bf848-97a3-4bd3-bd10-cbdcb8cbf250 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 02:59:47.625231 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Attempting to bind port 39c14867-cd45-4087-ae6b-c6c669cf7402 on network 007bf848-97a3-4bd3-bd10-cbdcb8cbf250 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:47.646852 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 59, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:59:47.653107 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Checking segment: {'id': '5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': '007bf848-97a3-4bd3-bd10-cbdcb8cbf250'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:47.653107 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Bound using segment: {'id': '5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': '007bf848-97a3-4bd3-bd10-cbdcb8cbf250'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:59:47.653107 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Bound port: 39c14867-cd45-4087-ae6b-c6c669cf7402, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 367, 'network_id': '007bf848-97a3-4bd3-bd10-cbdcb8cbf250'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:59:47.653386 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-6c109476-3e8d-44aa-9876-2658c1568c4f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:47.653611 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:47.653991 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-6c109476-3e8d-44aa-9876-2658c1568c4f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.43 "GET /v2.0/networks?id=4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 200 len: 818 time: 0.2041852 Aug 24 02:59:47.666884 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Request body: {'port': {'device_id': '89e6a64a-7412-4541-8c8b-5e9959ae0654', 'network_id': '4091852f-86f8-4dac-87af-44624502a74d', 'admin_state_up': True, 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:47.698650 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f0ffde50-7bfe-4690-8545-e75c7df28f0b tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/quotas/7e23b688defc49bc8fa4cf796a1bc390 HTTP/1.1" status: 200 len: 375 time: 0.0753369 Aug 24 02:59:47.818323 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] For port 39c14867-cd45-4087-ae6b-c6c669cf7402, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:59:47.842328 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-afe481e3-45f1-4bb5-9278-f5cc03e4252a tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1345243 Aug 24 02:59:47.905516 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] For port 39c14867-cd45-4087-ae6b-c6c669cf7402, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=39c14867-cd45-4087-ae6b-c6c669cf7402,segment=NetworkSegment(5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6),segment_id=5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:59:47.951677 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8fb01f94-4069-4e87-8642-90dd5b909b92 service neutron] 10.222.0.30 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1083097 Aug 24 02:59:48.009662 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:48.067724 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:48.068158 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ff20fdb5-cd3b-4888-90b6-cb7ef69756fa req-2c728ad0-992e-4200-8e1f-78e03f232a82 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 210 time: 0.0475750 Aug 24 02:59:48.069355 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:48.072864 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Made reservation on behalf of 174aaeccb001400ca9af9cfc9b1b87be for: {'port': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:59:48.084121 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] 10.222.0.43 "PUT /v2.0/ports/39c14867-cd45-4087-ae6b-c6c669cf7402 HTTP/1.1" status: 200 len: 1094 time: 2.1469626 Aug 24 02:59:48.084121 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae754fd3-e7a1-4454-806c-894608de1aaf', 'tag': '39c14867-cd45-4087-ae6b-c6c669cf7402'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 02:59:48.084370 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:48.193994 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87b2a791-4f57-4c6e-84e2-dad40c25b78a service neutron] Pushing event updated for resources: {'Port': ['ID=39c14867-cd45-4087-ae6b-c6c669cf7402,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:48.205015 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-aba9a759-7537-4ae6-a32a-af2aada5cc9c service neutron] 10.222.0.30 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2471619 Aug 24 02:59:48.347301 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-39ed6b41-6f01-4ef4-9a80-74cb5e2573a7" -d '{"events": [{"name": "network-changed", "server_uuid": "ae754fd3-e7a1-4454-806c-894608de1aaf", "tag": "39c14867-cd45-4087-ae6b-c6c669cf7402"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 02:59:48.347925 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ef664d-5239-42ef-89df-23668058f115 req-973521bb-7ce6-4c89-92af-559d48ee17b1 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:48.357793 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-47ef664d-5239-42ef-89df-23668058f115 req-973521bb-7ce6-4c89-92af-559d48ee17b1 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 944 time: 0.1321599 Aug 24 02:59:48.463972 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-47ef664d-5239-42ef-89df-23668058f115 req-a9b9b3a8-eff0-47ef-b3a0-362433062ae8 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1053092 Aug 24 02:59:48.472688 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Allocated IP 172.20.0.2 (4091852f-86f8-4dac-87af-44624502a74d/4f536c4e-b790-4630-bdc6-867501285c32/706be5c2-c6fb-496a-ac91-104e4cc11ae7) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:59:48.480187 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d86434ca-f051-4940-8f33-2275483305e7 req-c9ae14ca-b32f-49b5-bc04-fb4d8e8377c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:48.482127 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-c9ae14ca-b32f-49b5-bc04-fb4d8e8377c2 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=050fc06a8c0745b78a8d3f9a9d88ff3f&device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 1097 time: 0.0777893 Aug 24 02:59:48.551462 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-f58fc42c-4e46-4d00-a001-a97f17e406a2 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=39c14867-cd45-4087-ae6b-c6c669cf7402 HTTP/1.1" status: 200 len: 217 time: 0.0619478 Aug 24 02:59:48.555438 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.43', 63309) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:48.709659 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 02:59:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c464ee96-83d8-4412-9226-4629507dc2e4 x-openstack-request-id: req-c464ee96-83d8-4412-9226-4629507dc2e4 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 02:59:48.711422 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae754fd3-e7a1-4454-806c-894608de1aaf", "tag": "39c14867-cd45-4087-ae6b-c6c669cf7402", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 02:59:48.711422 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c464ee96-83d8-4412-9226-4629507dc2e4 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 02:59:48.711422 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae754fd3-e7a1-4454-806c-894608de1aaf', 'tag': '39c14867-cd45-4087-ae6b-c6c669cf7402', 'status': 'completed', 'code': 200} Aug 24 02:59:48.742119 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3b5a8e2-9c51-4276-9d53-84e32eb1861a req-ab650cf9-3c69-41d8-bdc5-446298c77378 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 210 time: 0.0685203 Aug 24 02:59:48.770714 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d86434ca-f051-4940-8f33-2275483305e7 req-61449a4e-7b17-4ec0-8899-8f386004f8c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:48.772413 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-61449a4e-7b17-4ec0-8899-8f386004f8c8 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=d9e864a8-ff3c-45e0-8d7e-5ffa4a457c88 HTTP/1.1" status: 200 len: 852 time: 0.2054441 Aug 24 02:59:48.887920 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-bf7c6094-8280-4dd3-84d1-b5614d9781e9 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=007bf848-97a3-4bd3-bd10-cbdcb8cbf250&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1083426 Aug 24 02:59:48.901133 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95154752-88cf-4fde-9b49-27ff15f26316 req-dda48af9-8346-4bd5-ad46-e0888d932ea4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:48.902691 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-dda48af9-8346-4bd5-ad46-e0888d932ea4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.43 "GET /v2.0/networks?id=4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 200 len: 818 time: 0.3369637 Aug 24 02:59:48.918196 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-95154752-88cf-4fde-9b49-27ff15f26316 req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Request body: {'port': {'device_id': 'cd5b8f9e-cb7a-4828-b977-8189ee4a6aef', 'network_id': '4091852f-86f8-4dac-87af-44624502a74d', 'admin_state_up': True, 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:48.955998 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:49.129556 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-96419053-66ec-4eac-9705-c4c8b492d51a service neutron] 10.222.0.43 "GET /v2.0/networks/007bf848-97a3-4bd3-bd10-cbdcb8cbf250?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2256081 Aug 24 02:59:49.135193 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:49.225922 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-95154752-88cf-4fde-9b49-27ff15f26316 req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Made reservation on behalf of 174aaeccb001400ca9af9cfc9b1b87be for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:59:49.229693 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-95154752-88cf-4fde-9b49-27ff15f26316 req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:49.270156 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d86434ca-f051-4940-8f33-2275483305e7 req-f10152c4-c9bd-4d98-ab44-72b192a7acc2 service neutron] 10.222.0.43 "GET /v2.0/networks/007bf848-97a3-4bd3-bd10-cbdcb8cbf250?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1329567 Aug 24 02:59:49.342205 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-da7dd992-5582-43e0-b7c0-39dac2ccc4f0 req-108970a5-38ec-4a2d-91bb-a5d7413fceee tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 210 time: 0.0496621 Aug 24 02:59:49.357998 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Network 4091852f-86f8-4dac-87af-44624502a74d is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:59:49.397122 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:49.397122 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:59:49.397122 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:49.397122 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for port, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:49.419235 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Pushing event updated for resources: {'Port': ['ID=706be5c2-c6fb-496a-ac91-104e4cc11ae7,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:49.643736 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ec68864d-b617-47d1-9deb-c170b94109f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.9833872 Aug 24 02:59:49.656914 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Request body: {'port': {'device_id': '89e6a64a-7412-4541-8c8b-5e9959ae0654', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:49.671363 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-95154752-88cf-4fde-9b49-27ff15f26316 req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Allocated IP 172.20.0.6 (4091852f-86f8-4dac-87af-44624502a74d/4f536c4e-b790-4630-bdc6-867501285c32/659513ab-6408-4e0e-b7d4-dea0216a385c) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:59:49.719081 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81662a8-113a-400f-adf1-58cb5c9ca9dc req-c121edf7-4c41-41c5-a3f9-1f18fc0f1772 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:49.719731 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:49.720578 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d81662a8-113a-400f-adf1-58cb5c9ca9dc req-c121edf7-4c41-41c5-a3f9-1f18fc0f1772 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 944 time: 0.1325505 Aug 24 02:59:49.725454 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39ed6b41-6f01-4ef4-9a80-74cb5e2573a7 req-1e266dd9-aa0e-41b4-bfd0-c76e65f4f3ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:49.727087 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-39ed6b41-6f01-4ef4-9a80-74cb5e2573a7 req-1e266dd9-aa0e-41b4-bfd0-c76e65f4f3ea service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=050fc06a8c0745b78a8d3f9a9d88ff3f&device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 1097 time: 0.1379042 Aug 24 02:59:49.972743 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6c353008-877e-40bf-8336-8be0a0c57137 req-35352057-0b8a-4e09-8448-0c7ba79d28a2 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 210 time: 0.1215491 Aug 24 02:59:49.997243 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d81662a8-113a-400f-adf1-58cb5c9ca9dc req-0284bc8f-cbde-42da-b9b5-61d72527381b tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2621284 Aug 24 02:59:50.044496 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39ed6b41-6f01-4ef4-9a80-74cb5e2573a7 req-c0617737-e166-44a4-9e23-0aec56f6ea87 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:50.046002 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-39ed6b41-6f01-4ef4-9a80-74cb5e2573a7 req-c0617737-e166-44a4-9e23-0aec56f6ea87 service neutron] 10.222.0.43 "GET /v2.0/networks?id=007bf848-97a3-4bd3-bd10-cbdcb8cbf250 HTTP/1.1" status: 200 len: 913 time: 0.3098850 Aug 24 02:59:50.099770 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-39ed6b41-6f01-4ef4-9a80-74cb5e2573a7 req-b2605d21-ec96-476a-bd54-39de90bbe205 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=39c14867-cd45-4087-ae6b-c6c669cf7402 HTTP/1.1" status: 200 len: 217 time: 0.0416501 Aug 24 02:59:50.110850 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-95154752-88cf-4fde-9b49-27ff15f26316 req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:50.172011 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39ed6b41-6f01-4ef4-9a80-74cb5e2573a7 req-825f3508-6c49-4f3f-9d1e-dd1e6b35c427 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:50.181476 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-39ed6b41-6f01-4ef4-9a80-74cb5e2573a7 req-825f3508-6c49-4f3f-9d1e-dd1e6b35c427 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=d9e864a8-ff3c-45e0-8d7e-5ffa4a457c88 HTTP/1.1" status: 200 len: 852 time: 0.0656796 Aug 24 02:59:50.221756 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-39ed6b41-6f01-4ef4-9a80-74cb5e2573a7 req-23b3e8ea-b587-4392-be1f-161c550053e6 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=007bf848-97a3-4bd3-bd10-cbdcb8cbf250&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0317690 Aug 24 02:59:50.305324 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-95154752-88cf-4fde-9b49-27ff15f26316 req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:50.371046 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Pushing event updated for resources: {'Port': ['ID=659513ab-6408-4e0e-b7d4-dea0216a385c,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:50.400865 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-95154752-88cf-4fde-9b49-27ff15f26316 req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Network 4091852f-86f8-4dac-87af-44624502a74d is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:59:50.403373 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-39ed6b41-6f01-4ef4-9a80-74cb5e2573a7 req-0049c764-60bf-477a-8a93-9c6f6b06f6bf service neutron] 10.222.0.43 "GET /v2.0/networks/007bf848-97a3-4bd3-bd10-cbdcb8cbf250?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1801906 Aug 24 02:59:50.404802 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-95154752-88cf-4fde-9b49-27ff15f26316 req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:50.408610 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-95154752-88cf-4fde-9b49-27ff15f26316 req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:59:50.414738 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95154752-88cf-4fde-9b49-27ff15f26316 req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:50.416031 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-95154752-88cf-4fde-9b49-27ff15f26316 req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:50.544811 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-39ed6b41-6f01-4ef4-9a80-74cb5e2573a7 req-1eab9f81-cfb2-4561-bb1b-ff70855510b6 service neutron] 10.222.0.43 "GET /v2.0/networks/007bf848-97a3-4bd3-bd10-cbdcb8cbf250?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1242278 Aug 24 02:59:50.563133 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 706be5c2-c6fb-496a-ac91-104e4cc11ae7 {{(pid=111275) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 02:59:50.568011 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-9ce7685a-0e65-4e0d-9b24-4fd57857cecd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6550090 Aug 24 02:59:50.573820 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:50.586097 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Request body: {'port': {'device_id': 'cd5b8f9e-cb7a-4828-b977-8189ee4a6aef', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:50.601779 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff8257db-565f-459f-bbca-0099042cf8be req-5cd87147-d846-46d7-9021-9084dfc0b435 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:50.603672 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ff8257db-565f-459f-bbca-0099042cf8be req-5cd87147-d846-46d7-9021-9084dfc0b435 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 931 time: 0.1023998 Aug 24 02:59:50.608973 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.provisioning_blocks [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Transition to ACTIVE for port object 706be5c2-c6fb-496a-ac91-104e4cc11ae7 will not be triggered until provisioned by entity L2. {{(pid=111275) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:59:50.676130 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ff8257db-565f-459f-bbca-0099042cf8be req-cf5d69cd-23e0-41de-bcad-08e597b3d50c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651288 Aug 24 02:59:50.694781 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:50.709556 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:50.816861 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Pushing event updated for resources: {'Port': ['ID=706be5c2-c6fb-496a-ac91-104e4cc11ae7,revision_number=2']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:50.848813 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.managers [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Attempting to bind port 706be5c2-c6fb-496a-ac91-104e4cc11ae7 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:59:50.849296 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.managers [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Attempting to bind port 706be5c2-c6fb-496a-ac91-104e4cc11ae7 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'}] {{(pid=111275) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:59:50.849771 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Attempting to bind port 706be5c2-c6fb-496a-ac91-104e4cc11ae7 on network 4091852f-86f8-4dac-87af-44624502a74d {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:50.856005 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Port 706be5c2-c6fb-496a-ac91-104e4cc11ae7 on network 4091852f-86f8-4dac-87af-44624502a74d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 02:59:50.856588 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Attempting to bind port 706be5c2-c6fb-496a-ac91-104e4cc11ae7 on network 4091852f-86f8-4dac-87af-44624502a74d {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:50.862026 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 59, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:59:50.862638 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Checking segment: {'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:50.863383 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Bound using segment: {'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'} {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:59:50.864131 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.managers [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Bound port: 706be5c2-c6fb-496a-ac91-104e4cc11ae7, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'}}] {{(pid=111275) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:59:50.864712 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:50.938517 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] For port 706be5c2-c6fb-496a-ac91-104e4cc11ae7, host hv-cinder-80374, cleared binding levels {{(pid=111275) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:59:50.945611 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] For port 706be5c2-c6fb-496a-ac91-104e4cc11ae7, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=706be5c2-c6fb-496a-ac91-104e4cc11ae7,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111275) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:59:51.022065 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 659513ab-6408-4e0e-b7d4-dea0216a385c {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 02:59:51.030959 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:51.036892 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:51.055075 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Transition to ACTIVE for port object 659513ab-6408-4e0e-b7d4-dea0216a385c will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:59:51.070389 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-93033ae2-09d9-40df-b456-3379c5be151e req-d8858ffe-c030-4a56-953e-cc4f049b6547 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 210 time: 0.0323088 Aug 24 02:59:51.082230 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:51.083090 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for port, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:51.084758 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] 10.222.0.43 "PUT /v2.0/ports/706be5c2-c6fb-496a-ac91-104e4cc11ae7 HTTP/1.1" status: 200 len: 1093 time: 1.4334683 Aug 24 02:59:51.085181 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '89e6a64a-7412-4541-8c8b-5e9959ae0654', 'tag': '706be5c2-c6fb-496a-ac91-104e4cc11ae7'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 02:59:51.207782 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feaa2ce5-c52c-4ac0-ac71-31b192e9dd36 service neutron] Pushing event updated for resources: {'Port': ['ID=706be5c2-c6fb-496a-ac91-104e4cc11ae7,revision_number=3']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:51.226581 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40819e2c-558e-4b77-957e-f1cf3faacff3 req-c938779c-0e49-4145-a65b-80dd8281b5a4 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:51.228835 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-40819e2c-558e-4b77-957e-f1cf3faacff3 req-c938779c-0e49-4145-a65b-80dd8281b5a4 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 944 time: 0.0821629 Aug 24 02:59:51.254478 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:51.263163 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-74e5c759-de29-45de-bf3d-91d68d12961b" -d '{"events": [{"name": "network-changed", "server_uuid": "89e6a64a-7412-4541-8c8b-5e9959ae0654", "tag": "706be5c2-c6fb-496a-ac91-104e4cc11ae7"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 02:59:51.273298 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-40819e2c-558e-4b77-957e-f1cf3faacff3 req-37bedc41-8980-4d32-b898-820f4d1e7416 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381536 Aug 24 02:59:51.363753 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Pushing event updated for resources: {'Port': ['ID=659513ab-6408-4e0e-b7d4-dea0216a385c,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:51.374871 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Attempting to bind port 659513ab-6408-4e0e-b7d4-dea0216a385c on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:59:51.375382 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Attempting to bind port 659513ab-6408-4e0e-b7d4-dea0216a385c by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:59:51.376027 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Attempting to bind port 659513ab-6408-4e0e-b7d4-dea0216a385c on network 4091852f-86f8-4dac-87af-44624502a74d {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:51.381990 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Port 659513ab-6408-4e0e-b7d4-dea0216a385c on network 4091852f-86f8-4dac-87af-44624502a74d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 02:59:51.382584 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Attempting to bind port 659513ab-6408-4e0e-b7d4-dea0216a385c on network 4091852f-86f8-4dac-87af-44624502a74d {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:51.388295 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 59, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:59:51.388693 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Checking segment: {'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:51.389236 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Bound using segment: {'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:59:51.389819 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Bound port: 659513ab-6408-4e0e-b7d4-dea0216a385c, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ce2978d1-5398-4e68-abb9-9457b1c81992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '4091852f-86f8-4dac-87af-44624502a74d'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:59:51.390245 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:51.439749 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-b66f494c-3bb9-4984-b332-4e336060305f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:51.441514 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-b66f494c-3bb9-4984-b332-4e336060305f service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 1096 time: 0.0992241 Aug 24 02:59:51.446598 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-39d41a99-1af0-4b4e-9be2-41cb22de07db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:51.472166 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] For port 659513ab-6408-4e0e-b7d4-dea0216a385c, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:59:51.475184 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] For port 659513ab-6408-4e0e-b7d4-dea0216a385c, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=659513ab-6408-4e0e-b7d4-dea0216a385c,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:59:51.488139 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 02:59:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-adc96e16-8311-4654-b366-36bd99b4317f x-openstack-request-id: req-adc96e16-8311-4654-b366-36bd99b4317f {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 02:59:51.488514 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "89e6a64a-7412-4541-8c8b-5e9959ae0654", "tag": "706be5c2-c6fb-496a-ac91-104e4cc11ae7", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 02:59:51.488864 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-adc96e16-8311-4654-b366-36bd99b4317f {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 02:59:51.489408 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '89e6a64a-7412-4541-8c8b-5e9959ae0654', 'tag': '706be5c2-c6fb-496a-ac91-104e4cc11ae7', 'status': 'completed', 'code': 200} Aug 24 02:59:51.522032 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-ed147505-55c9-495e-95ea-5edc0f5803fa service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=706be5c2-c6fb-496a-ac91-104e4cc11ae7 HTTP/1.1" status: 200 len: 217 time: 0.0713456 Aug 24 02:59:51.568653 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:51.621803 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-8024271e-5f85-413a-9757-43103cc7a61b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:51.623235 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Pushing event updated for resources: {'Port': ['ID=659513ab-6408-4e0e-b7d4-dea0216a385c,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:51.623670 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-8024271e-5f85-413a-9757-43103cc7a61b service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4f536c4e-b790-4630-bdc6-867501285c32 HTTP/1.1" status: 200 len: 858 time: 0.0910895 Aug 24 02:59:51.637076 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:51.638080 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:51.639579 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-4464146e-a363-414f-a7d5-755803f453fe service neutron] 10.222.0.43 "PUT /v2.0/ports/659513ab-6408-4e0e-b7d4-dea0216a385c HTTP/1.1" status: 200 len: 1093 time: 1.0635490 Aug 24 02:59:51.640045 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cd5b8f9e-cb7a-4828-b977-8189ee4a6aef', 'tag': '659513ab-6408-4e0e-b7d4-dea0216a385c'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 02:59:51.647474 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c322552c-1b9d-4081-8be2-fa18d8e1a949" -d '{"events": [{"name": "network-changed", "server_uuid": "cd5b8f9e-cb7a-4828-b977-8189ee4a6aef", "tag": "659513ab-6408-4e0e-b7d4-dea0216a385c"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 02:59:51.691356 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 02:59:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-daa8cf08-c78f-47cf-a835-5c5f4f917dc3 x-openstack-request-id: req-daa8cf08-c78f-47cf-a835-5c5f4f917dc3 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 02:59:51.691356 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cd5b8f9e-cb7a-4828-b977-8189ee4a6aef", "tag": "659513ab-6408-4e0e-b7d4-dea0216a385c", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 02:59:51.691603 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-daa8cf08-c78f-47cf-a835-5c5f4f917dc3 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 02:59:51.691927 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cd5b8f9e-cb7a-4828-b977-8189ee4a6aef', 'tag': '659513ab-6408-4e0e-b7d4-dea0216a385c', 'status': 'completed', 'code': 200} Aug 24 02:59:51.695612 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-7bbf606d-8aae-474b-b5c1-4a5a4f824c52 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=4091852f-86f8-4dac-87af-44624502a74d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0563433 Aug 24 02:59:51.842503 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-3360709c-ae8b-4f66-abf1-948115627d55 service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1395147 Aug 24 02:59:51.872809 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c322552c-1b9d-4081-8be2-fa18d8e1a949 req-b7e787c9-9c4c-426f-9d5e-a70f2062c93a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:51.874632 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c322552c-1b9d-4081-8be2-fa18d8e1a949 req-b7e787c9-9c4c-426f-9d5e-a70f2062c93a service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 1096 time: 0.1334758 Aug 24 02:59:51.907458 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bdb965b-3522-4db7-b755-3f3ccc252db5 req-5c8f9f1c-a6ed-4a8e-8439-74ad990d22c8 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:51.908962 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0bdb965b-3522-4db7-b755-3f3ccc252db5 req-5c8f9f1c-a6ed-4a8e-8439-74ad990d22c8 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 943 time: 0.1088307 Aug 24 02:59:51.955509 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0bdb965b-3522-4db7-b755-3f3ccc252db5 req-3437aa6e-329f-413d-a782-2b3dfca73a3c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396383 Aug 24 02:59:52.181533 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-54b8b79b-3c23-492b-800c-75043336a7dd req-8aac8691-1a2c-45f0-9a98-cdecaf592b20 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 210 time: 0.0265212 Aug 24 02:59:52.299875 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59800) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:52.401709 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c5cfa8f-54b9-4b86-9b14-063ceb67db0a req-2e7a4a07-fe10-42f2-b803-c18de12c5453 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:52.403266 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4c5cfa8f-54b9-4b86-9b14-063ceb67db0a req-2e7a4a07-fe10-42f2-b803-c18de12c5453 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 944 time: 0.0541646 Aug 24 02:59:52.423055 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-222f7f7b-408c-4686-92f3-345218eccfa6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:52.464532 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4c5cfa8f-54b9-4b86-9b14-063ceb67db0a req-5c212ff0-8711-40b9-8e6d-81f4f25e2d44 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537620 Aug 24 02:59:52.532489 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-222f7f7b-408c-4686-92f3-345218eccfa6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:52.637114 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-222f7f7b-408c-4686-92f3-345218eccfa6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:52.686678 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-222f7f7b-408c-4686-92f3-345218eccfa6 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=84d002df507541aca95a3f92a4e3fbe7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3856771 Aug 24 02:59:52.687730 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-222f7f7b-408c-4686-92f3-345218eccfa6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64c4da3f-a15c-45f3-a469-7ed096df1a28,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:52.689771 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59818) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:52.748642 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5d14dc1d-b015-42b7-b806-bf820ff3799c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:52.769697 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5d14dc1d-b015-42b7-b806-bf820ff3799c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:52.789006 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 39c14867-cd45-4087-ae6b-c6c669cf7402 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 02:59:52.906484 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 39c14867-cd45-4087-ae6b-c6c669cf7402, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=39c14867-cd45-4087-ae6b-c6c669cf7402,segment=NetworkSegment(5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6),segment_id=5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:52.916656 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '39c14867-cd45-4087-ae6b-c6c669cf7402', 'network_id': '007bf848-97a3-4bd3-bd10-cbdcb8cbf250', 'port_id': '39c14867-cd45-4087-ae6b-c6c669cf7402', 'mac_address': 'fa:16:3e:8d:e6:65', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 367, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd9e864a8-ff3c-45e0-8d7e-5ffa4a457c88', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 02:59:52.926233 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5d14dc1d-b015-42b7-b806-bf820ff3799c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:52.928744 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5d14dc1d-b015-42b7-b806-bf820ff3799c admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:52.929914 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-5d14dc1d-b015-42b7-b806-bf820ff3799c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/64c4da3f-a15c-45f3-a469-7ed096df1a28 HTTP/1.1" status: 204 len: 168 time: 0.2391672 Aug 24 02:59:52.944108 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d14dc1d-b015-42b7-b806-bf820ff3799c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64c4da3f-a15c-45f3-a469-7ed096df1a28,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:52.975779 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:53.018246 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 39c14867-cd45-4087-ae6b-c6c669cf7402 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 02:59:53.041013 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 39c14867-cd45-4087-ae6b-c6c669cf7402, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=39c14867-cd45-4087-ae6b-c6c669cf7402,segment=NetworkSegment(5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6),segment_id=5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:53.093134 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75431a53-38db-46e2-aa29-9348ddb95794 req-7cae0ec7-1ad5-4980-9b35-9c7192a20f85 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:53.094727 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-75431a53-38db-46e2-aa29-9348ddb95794 req-7cae0ec7-1ad5-4980-9b35-9c7192a20f85 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 943 time: 0.0539474 Aug 24 02:59:53.098732 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59834) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:53.147150 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-75431a53-38db-46e2-aa29-9348ddb95794 req-ad3d13a9-a8ae-490b-ae4a-d34782cbe7ad tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386894 Aug 24 02:59:53.172322 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:53.228109 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=39c14867-cd45-4087-ae6b-c6c669cf7402,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:53.298317 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bcd295bf-001b-473d-bb73-8ead1622dcbc req-fe2c7b9e-95bc-4a73-a7f5-d3a8c6f455d4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 210 time: 0.0283532 Aug 24 02:59:53.330744 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-56be5f06-31ed-4ee6-ab98-d23ae3c63e1b admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:53.422233 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-56be5f06-31ed-4ee6-ab98-d23ae3c63e1b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:53.509829 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-56be5f06-31ed-4ee6-ab98-d23ae3c63e1b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:53.559876 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-56be5f06-31ed-4ee6-ab98-d23ae3c63e1b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2ae4d5518c2e406294a4ce28befab798&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4597557 Aug 24 02:59:53.569093 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56be5f06-31ed-4ee6-ab98-d23ae3c63e1b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5b9e06e4-cc3a-41a7-815d-e4c5c2eb182d,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:53.572375 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59848) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:53.598094 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eb53faf-669d-402a-b637-002772e543bf req-fe3cbbc7-a85e-4bd9-83da-2f8104c8236a tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:53.599886 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6eb53faf-669d-402a-b637-002772e543bf req-fe3cbbc7-a85e-4bd9-83da-2f8104c8236a tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 945 time: 0.0651684 Aug 24 02:59:53.638964 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7f1a688a-df3a-4f52-9373-9b17362e18f3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:53.683763 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6eb53faf-669d-402a-b637-002772e543bf req-315134be-4629-4e02-a87a-7674a3ef9cc4 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753129 Aug 24 02:59:53.686672 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7f1a688a-df3a-4f52-9373-9b17362e18f3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:53.805091 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59854) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:53.817976 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c0cc27e9-ddbc-4148-9ba9-78e37f63fc30 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:53.853112 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7f1a688a-df3a-4f52-9373-9b17362e18f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:53.855737 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7f1a688a-df3a-4f52-9373-9b17362e18f3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:53.856862 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-7f1a688a-df3a-4f52-9373-9b17362e18f3 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5b9e06e4-cc3a-41a7-815d-e4c5c2eb182d HTTP/1.1" status: 204 len: 168 time: 0.2834604 Aug 24 02:59:53.872439 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f1a688a-df3a-4f52-9373-9b17362e18f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b9e06e4-cc3a-41a7-815d-e4c5c2eb182d,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:53.926427 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c0cc27e9-ddbc-4148-9ba9-78e37f63fc30 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:54.008319 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-611ecb4e-9610-4847-b16c-617d9e945c75 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:54.087201 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c0cc27e9-ddbc-4148-9ba9-78e37f63fc30 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:54.125329 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-c0cc27e9-ddbc-4148-9ba9-78e37f63fc30 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=1fb8fd5453a14a4ea16d36776673695d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3199241 Aug 24 02:59:54.126207 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0cc27e9-ddbc-4148-9ba9-78e37f63fc30 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa61214e-cafd-4637-a3f9-fde6f71e2036,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:54.128226 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59858) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:54.186363 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-17ba050c-1b94-4b96-b532-879484a85341 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:54.208407 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-17ba050c-1b94-4b96-b532-879484a85341 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:54.264442 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ae864f-64c1-4a1c-b7f9-0c8ea038e9cd req-5e7a33da-4f3d-4ab0-8824-e15bb93bab07 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:54.266014 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d7ae864f-64c1-4a1c-b7f9-0c8ea038e9cd req-5e7a33da-4f3d-4ab0-8824-e15bb93bab07 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 943 time: 0.0536263 Aug 24 02:59:54.311743 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d7ae864f-64c1-4a1c-b7f9-0c8ea038e9cd req-af33a300-e618-462b-af8e-2cb0a2091025 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391741 Aug 24 02:59:54.362467 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-17ba050c-1b94-4b96-b532-879484a85341 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:54.365649 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-17ba050c-1b94-4b96-b532-879484a85341 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:54.367072 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-17ba050c-1b94-4b96-b532-879484a85341 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/aa61214e-cafd-4637-a3f9-fde6f71e2036 HTTP/1.1" status: 204 len: 168 time: 0.2377896 Aug 24 02:59:54.377398 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17ba050c-1b94-4b96-b532-879484a85341 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa61214e-cafd-4637-a3f9-fde6f71e2036,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:54.406046 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:54.565227 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-958f4982-b29f-4856-bd2e-1ae53ec98a74 req-5966f764-439c-4242-9c4b-01789a72b3c0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 210 time: 0.1799941 Aug 24 02:59:54.675109 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3ca8d66b-d8cd-4d6f-b465-d8c44c2e775e req-2f0c5b22-e183-46fd-bd2f-42d5f4522eb3 service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1052475 Aug 24 02:59:54.856679 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['39c14867-cd45-4087-ae6b-c6c669cf7402'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 02:59:54.885006 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74e5c759-de29-45de-bf3d-91d68d12961b req-0995d43e-22bd-4133-a262-396eeac38b40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:54.886766 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-74e5c759-de29-45de-bf3d-91d68d12961b req-0995d43e-22bd-4133-a262-396eeac38b40 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 1096 time: 0.0465336 Aug 24 02:59:54.997098 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59880) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:55.034577 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-30a8543b-73f9-46c1-8822-1370f9f1887b admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:55.143406 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c322552c-1b9d-4081-8be2-fa18d8e1a949 req-5c16191b-1f24-4763-ab59-ada1d59193f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:55.145039 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c322552c-1b9d-4081-8be2-fa18d8e1a949 req-5c16191b-1f24-4763-ab59-ada1d59193f0 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&shared=False HTTP/1.1" status: 200 len: 919 time: 0.5635998 Aug 24 02:59:55.153142 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f18729be-00a4-4d42-97af-76afc8b32584 req-f3e4b103-161a-442b-b28f-e9d94c2c5de3 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:55.155227 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f18729be-00a4-4d42-97af-76afc8b32584 req-f3e4b103-161a-442b-b28f-e9d94c2c5de3 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 945 time: 0.2399852 Aug 24 02:59:55.156455 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74e5c759-de29-45de-bf3d-91d68d12961b req-7bc502ec-7676-45af-9aa5-8dfa866f6d4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:55.158136 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-74e5c759-de29-45de-bf3d-91d68d12961b req-7bc502ec-7676-45af-9aa5-8dfa866f6d4a service neutron] 10.222.0.43 "GET /v2.0/networks?id=4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 200 len: 919 time: 0.2632732 Aug 24 02:59:55.209775 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-74e5c759-de29-45de-bf3d-91d68d12961b req-14a93374-59e5-4256-bee8-6441ebf4a1b3 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=706be5c2-c6fb-496a-ac91-104e4cc11ae7 HTTP/1.1" status: 200 len: 217 time: 0.0427923 Aug 24 02:59:55.261736 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-b54ffe4a-af46-4c45-854f-0a2dbec51f71 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:55.263010 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-b54ffe4a-af46-4c45-854f-0a2dbec51f71 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.43 "GET /v2.0/networks?id=f35e751d-f371-4788-abda-6a58b8a779df HTTP/1.1" status: 200 len: 810 time: 0.6803625 Aug 24 02:59:55.290000 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74e5c759-de29-45de-bf3d-91d68d12961b req-4aa5e402-8f0a-4c3a-9c34-74d221a0d0c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:55.291709 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-74e5c759-de29-45de-bf3d-91d68d12961b req-4aa5e402-8f0a-4c3a-9c34-74d221a0d0c8 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4f536c4e-b790-4630-bdc6-867501285c32 HTTP/1.1" status: 200 len: 858 time: 0.0730243 Aug 24 02:59:55.317219 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-30a8543b-73f9-46c1-8822-1370f9f1887b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:55.336883 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-74e5c759-de29-45de-bf3d-91d68d12961b req-a700ae1b-6ab9-4854-b432-920c10c64cb6 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=4091852f-86f8-4dac-87af-44624502a74d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0363078 Aug 24 02:59:55.381081 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f18729be-00a4-4d42-97af-76afc8b32584 req-0e518783-0ea9-417d-abed-cdf4ed0491c2 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2003982 Aug 24 02:59:55.412064 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-36640190-e5b5-46fe-bb45-b9135d74438d tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.43 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7e23b688defc49bc8fa4cf796a1bc390 HTTP/1.1" status: 200 len: 380 time: 0.1287224 Aug 24 02:59:55.419699 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c322552c-1b9d-4081-8be2-fa18d8e1a949 req-0de1c299-78a4-426a-b0a2-a24431c14947 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:55.421390 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c322552c-1b9d-4081-8be2-fa18d8e1a949 req-0de1c299-78a4-426a-b0a2-a24431c14947 service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2622218 Aug 24 02:59:55.426957 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Request body: {'port': {'device_id': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'admin_state_up': True, 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'security_groups': ['9efe755d-a2a2-41c1-926c-a4d4a12f8864']}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:55.469022 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-30a8543b-73f9-46c1-8822-1370f9f1887b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:55.511789 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df54e6a-1130-4435-9e5f-9f45881b26b1 req-f7d09570-1f2c-42b2-bd2e-7a381733bb52 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:55.513514 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0df54e6a-1130-4435-9e5f-9f45881b26b1 req-f7d09570-1f2c-42b2-bd2e-7a381733bb52 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 943 time: 0.1056821 Aug 24 02:59:55.536035 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-74e5c759-de29-45de-bf3d-91d68d12961b req-6e90381a-d168-479a-b397-1345e660ce74 service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1902122 Aug 24 02:59:55.551199 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-30a8543b-73f9-46c1-8822-1370f9f1887b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=287cd6389bec4becb9a43b53af639cd0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5506206 Aug 24 02:59:55.552042 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59894) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:55.562561 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:55.563125 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a8543b-73f9-46c1-8822-1370f9f1887b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b63618ff-b7a3-46d2-8a48-8c3e8ae220c0,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:55.572920 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95154752-88cf-4fde-9b49-27ff15f26316 req-f6309738-593c-4a53-bf6d-3cfbc5fbac73 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:55.575789 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-f6309738-593c-4a53-bf6d-3cfbc5fbac73 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 1096 time: 0.0792005 Aug 24 02:59:55.635909 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0df54e6a-1130-4435-9e5f-9f45881b26b1 req-c9662ebf-cf5c-4a69-a2e2-fa8e9cccd5fa tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1148572 Aug 24 02:59:55.652626 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-eff119d1-a2bc-412a-a0e6-2b6ee626c4dd service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=659513ab-6408-4e0e-b7d4-dea0216a385c HTTP/1.1" status: 200 len: 217 time: 0.0610182 Aug 24 02:59:55.682356 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-74e5c759-de29-45de-bf3d-91d68d12961b req-045d3e4c-2188-4c24-b712-1ab08998434f service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1368670 Aug 24 02:59:55.743227 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e5e16612-1f98-44f3-bfee-2777eb4f7d51 req-45934da7-a3a1-4fba-b9a4-609934d25e81 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 210 time: 0.0443873 Aug 24 02:59:55.756404 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95154752-88cf-4fde-9b49-27ff15f26316 req-2ed3522d-3a69-4e6f-902d-280bb4b473cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:55.759739 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-2ed3522d-3a69-4e6f-902d-280bb4b473cb service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4f536c4e-b790-4630-bdc6-867501285c32 HTTP/1.1" status: 200 len: 858 time: 0.0978019 Aug 24 02:59:55.796545 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-53b2903f-0677-431c-98d4-f54ec9d3bf3f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:55.800443 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-a570a43e-4a40-4cf6-9c59-4ff2cd108aef service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=4091852f-86f8-4dac-87af-44624502a74d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0349109 Aug 24 02:59:55.831171 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Made reservation on behalf of 7e23b688defc49bc8fa4cf796a1bc390 for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:59:55.834789 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:55.880317 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-53b2903f-0677-431c-98d4-f54ec9d3bf3f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.030841 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59922) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:56.051250 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-b3c436a0-121a-448b-86f3-59f5a07e90f9 service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2424083 Aug 24 02:59:56.165138 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1065971871-network', 'tenant_id': 'b2a25da75ef64218929e077ad77a0faa'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:56.177283 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Allocated IP 172.20.0.12 (f35e751d-f371-4788-abda-6a58b8a779df/14102a94-a55b-43e1-a7a9-4210a4c2e2fb/b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 02:59:56.203575 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-95154752-88cf-4fde-9b49-27ff15f26316 req-464f5054-0705-4514-a0a8-e068a5f5894c service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1423101 Aug 24 02:59:56.228749 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-53b2903f-0677-431c-98d4-f54ec9d3bf3f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.231383 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-53b2903f-0677-431c-98d4-f54ec9d3bf3f admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.232866 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-53b2903f-0677-431c-98d4-f54ec9d3bf3f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b63618ff-b7a3-46d2-8a48-8c3e8ae220c0 HTTP/1.1" status: 204 len: 168 time: 0.6794157 Aug 24 02:59:56.255395 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53b2903f-0677-431c-98d4-f54ec9d3bf3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b63618ff-b7a3-46d2-8a48-8c3e8ae220c0,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:56.288469 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Made reservation on behalf of b2a25da75ef64218929e077ad77a0faa for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:59:56.291671 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.300976 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.354789 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.370081 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Transition to ACTIVE for port object b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:59:56.401343 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.508728 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b55304-7d99-48e7-a81b-f54c54a78def req-c6373120-2577-420e-bf40-64735e661d31 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:56.510892 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a5b55304-7d99-48e7-a81b-f54c54a78def req-c6373120-2577-420e-bf40-64735e661d31 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 945 time: 0.0510268 Aug 24 02:59:56.546980 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a5b55304-7d99-48e7-a81b-f54c54a78def req-997c7258-9f42-471d-a905-05db73da9c69 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304620 Aug 24 02:59:56.559496 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 706be5c2-c6fb-496a-ac91-104e4cc11ae7 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 02:59:56.580855 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.624397 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 39c14867-cd45-4087-ae6b-c6c669cf7402 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:59:56.638572 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Network f35e751d-f371-4788-abda-6a58b8a779df is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 02:59:56.642322 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.659421 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] vlan segment allocate from pool success with {'vlan_id': 392, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 02:59:56.661006 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:56.685140 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.686733 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Added segment 9f912ca7-8981-46bc-8e03-7510f43d46b7 of type vlan for network 8711ab0f-364a-4faf-b32f-902626cda653 Aug 24 02:59:56.696483 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 02:59:56.722723 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:56.728734 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.748388 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 706be5c2-c6fb-496a-ac91-104e4cc11ae7, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=706be5c2-c6fb-496a-ac91-104e4cc11ae7,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:56.771799 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '706be5c2-c6fb-496a-ac91-104e4cc11ae7', 'network_id': '4091852f-86f8-4dac-87af-44624502a74d', 'port_id': '706be5c2-c6fb-496a-ac91-104e4cc11ae7', 'mac_address': 'fa:16:3e:91:c3:fd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 382, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4f536c4e-b790-4630-bdc6-867501285c32', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 02:59:56.773632 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event updated for resources: {'Port': ['ID=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:56.803064 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 39c14867-cd45-4087-ae6b-c6c669cf7402 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:59:56.835588 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 59938) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:56.867183 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.900435 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb70362-056b-4f06-8879-982d39de333e req-07e2fbd8-a96d-4236-9fe2-8f93962bcb39 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:56.902488 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ddd7e35e-b3b2-4dc2-a2f9-99bc925a47b1,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:56.903694 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.924430 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0bb70362-056b-4f06-8879-982d39de333e req-07e2fbd8-a96d-4236-9fe2-8f93962bcb39 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 943 time: 0.1283362 Aug 24 02:59:56.938431 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 39c14867-cd45-4087-ae6b-c6c669cf7402 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:56.939445 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:56.949085 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-f9c66f5f-2827-4fe8-a79a-309cfe315066 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5264628 Aug 24 02:59:56.963657 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Request body: {'port': {'device_id': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:57.025791 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 706be5c2-c6fb-496a-ac91-104e4cc11ae7 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 02:59:57.055396 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.062885 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 706be5c2-c6fb-496a-ac91-104e4cc11ae7, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=706be5c2-c6fb-496a-ac91-104e4cc11ae7,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:57.070057 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4e51ab5-8468-4728-b167-4fd34f3d13ca req-dcedee86-83c9-4926-bad8-3aa26c7e77e4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:57.080617 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a4e51ab5-8468-4728-b167-4fd34f3d13ca req-dcedee86-83c9-4926-bad8-3aa26c7e77e4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 932 time: 0.1617017 Aug 24 02:59:57.095633 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.096542 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:57.097104 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.158211 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0bb70362-056b-4f06-8879-982d39de333e req-97819084-aef2-4bf9-8d06-9a12968c2901 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2262580 Aug 24 02:59:57.174656 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.187151 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.224727 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.227862 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae754fd3-e7a1-4454-806c-894608de1aaf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39c14867-cd45-4087-ae6b-c6c669cf7402'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 02:59:57.240130 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-de012c54-e7a7-43c3-8155-9af5ac9082cb admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.246102 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a4e51ab5-8468-4728-b167-4fd34f3d13ca req-76caedc3-d0eb-4076-b1c3-76aaf90715b4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1629977 Aug 24 02:59:57.251182 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] Pushing event updated for resources: {'Network': ['ID=8711ab0f-364a-4faf-b32f-902626cda653,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:57.288733 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 39c14867-cd45-4087-ae6b-c6c669cf7402, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=39c14867-cd45-4087-ae6b-c6c669cf7402,segment=NetworkSegment(5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6),segment_id=5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:57.291568 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 8711ab0f-364a-4faf-b32f-902626cda653 details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 02:59:57.345970 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59964) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:57.347458 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-3d751b6c-599d-4a5a-b4b8-10dda03eaa00 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.3152921 Aug 24 02:59:57.353625 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-32e47405-51f8-4d0c-a82a-22748912d0bb admin admin] Request body: {'subnet': {'network_id': '8711ab0f-364a-4faf-b32f-902626cda653', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1065971871-subnet', 'tenant_id': 'b2a25da75ef64218929e077ad77a0faa', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 02:59:57.444953 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-8cbb923a-ac8d-4d61-a2ff-5282e00f4a89 None None] Provisioning for port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:59:57.447673 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.492421 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-8cbb923a-ac8d-4d61-a2ff-5282e00f4a89 None None] Provisioning complete for port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:57.493380 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-8cbb923a-ac8d-4d61-a2ff-5282e00f4a89 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.499674 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7d42222-35da-4904-8b33-606e5b105f0e" -d '{"events": [{"server_uuid": "ae754fd3-e7a1-4454-806c-894608de1aaf", "name": "network-vif-plugged", "status": "completed", "tag": "39c14867-cd45-4087-ae6b-c6c669cf7402"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 02:59:57.500743 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-de012c54-e7a7-43c3-8155-9af5ac9082cb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.551333 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['706be5c2-c6fb-496a-ac91-104e4cc11ae7'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 02:59:57.562918 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 02:59:57.571464 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.573365 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-de012c54-e7a7-43c3-8155-9af5ac9082cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.595057 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Transition to ACTIVE for port object b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 02:59:57.595375 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=706be5c2-c6fb-496a-ac91-104e4cc11ae7,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:57.640839 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-de012c54-e7a7-43c3-8155-9af5ac9082cb admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=f6a9079a83a84fe69509f8d237d33aa8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7997262 Aug 24 02:59:57.644015 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 59978) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:57.656062 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-8cbb923a-ac8d-4d61-a2ff-5282e00f4a89 None None] Port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 02:59:57.669657 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de012c54-e7a7-43c3-8155-9af5ac9082cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f193646c-7913-41a3-a451-abbf219558c9,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:57.690761 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.720871 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=39c14867-cd45-4087-ae6b-c6c669cf7402,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:57.767465 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-32e47405-51f8-4d0c-a82a-22748912d0bb admin admin] Made reservation on behalf of b2a25da75ef64218929e077ad77a0faa for: {'subnet': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 02:59:57.771218 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-32e47405-51f8-4d0c-a82a-22748912d0bb admin admin] Notify callbacks [] for subnet, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.785291 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e135479-3714-48f6-b0e7-afdbee8db278 req-dcfe3abe-21c5-466d-9104-c2c823ca0914 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:57.796381 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9e135479-3714-48f6-b0e7-afdbee8db278 req-dcfe3abe-21c5-466d-9104-c2c823ca0914 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.1497884 Aug 24 02:59:57.855440 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bc49c6e7-5106-4b47-805a-2456c5f296de admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.856932 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 02:59:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aa5a4ef2-f6c5-4bf4-9dc1-fe4f8bc2764d x-openstack-request-id: req-aa5a4ef2-f6c5-4bf4-9dc1-fe4f8bc2764d {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 02:59:57.857442 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae754fd3-e7a1-4454-806c-894608de1aaf", "name": "network-vif-plugged", "status": "completed", "tag": "39c14867-cd45-4087-ae6b-c6c669cf7402", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 02:59:57.857861 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-aa5a4ef2-f6c5-4bf4-9dc1-fe4f8bc2764d {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 02:59:57.858441 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae754fd3-e7a1-4454-806c-894608de1aaf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39c14867-cd45-4087-ae6b-c6c669cf7402', 'code': 200} Aug 24 02:59:57.869301 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Pushing event updated for resources: {'Port': ['ID=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:57.876809 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9e135479-3714-48f6-b0e7-afdbee8db278 req-a05805c0-230f-464e-b7ec-589f050d3d09 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0716579 Aug 24 02:59:57.948642 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bc49c6e7-5106-4b47-805a-2456c5f296de admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:57.950672 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Attempting to bind port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 02:59:57.951006 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Attempting to bind port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 02:59:57.951332 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Attempting to bind port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd on network f35e751d-f371-4788-abda-6a58b8a779df {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:57.984920 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd on network f35e751d-f371-4788-abda-6a58b8a779df not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 02:59:57.984920 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Attempting to bind port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd on network f35e751d-f371-4788-abda-6a58b8a779df {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 02:59:58.002631 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 2, 59, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 02:59:58.002957 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Checking segment: {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:58.003341 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Bound using segment: {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 02:59:58.003900 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Bound port: b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 02:59:58.004161 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:58.142361 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] For port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 02:59:58.163637 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] For port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 02:59:58.219589 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bc49c6e7-5106-4b47-805a-2456c5f296de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:58.222660 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bc49c6e7-5106-4b47-805a-2456c5f296de admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:58.224158 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-bc49c6e7-5106-4b47-805a-2456c5f296de admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/f193646c-7913-41a3-a451-abbf219558c9 HTTP/1.1" status: 204 len: 168 time: 0.5788453 Aug 24 02:59:58.235393 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc49c6e7-5106-4b47-805a-2456c5f296de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f193646c-7913-41a3-a451-abbf219558c9,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:58.393739 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7435c9c9-be15-4057-a26c-7a9fe58423c4 req-9f789e26-2130-4273-851f-5f2a96ef8efc tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:58.402129 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7435c9c9-be15-4057-a26c-7a9fe58423c4 req-9f789e26-2130-4273-851f-5f2a96ef8efc tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 944 time: 0.0661280 Aug 24 02:59:58.409984 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:58.412037 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-32e47405-51f8-4d0c-a82a-22748912d0bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for subnet, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:58.437477 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7435c9c9-be15-4057-a26c-7a9fe58423c4 req-3f548bbd-dd88-411c-8518-71670a3620a0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0342755 Aug 24 02:59:58.457850 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-130dab75-6b79-451a-98cf-19b0eaca61df req-1111eb48-91d8-45f2-ac26-1f6032c97e08 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:58.459373 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-130dab75-6b79-451a-98cf-19b0eaca61df req-1111eb48-91d8-45f2-ac26-1f6032c97e08 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 943 time: 0.2262211 Aug 24 02:59:58.475918 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:58.476736 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:58.478887 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] 10.222.0.43 "PUT /v2.0/ports/b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd HTTP/1.1" status: 200 len: 1094 time: 1.5199406 Aug 24 02:59:58.487257 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'tag': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 02:59:58.489447 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1d2bfd44-629e-4b52-963a-b497c29fd745" -d '{"events": [{"name": "network-changed", "server_uuid": "d7a111a5-6dc1-4030-adaf-661abcbcea71", "tag": "b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 02:59:58.538547 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 02:59:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6833f077-dbb4-45b2-a72a-4a41e6bf598c x-openstack-request-id: req-6833f077-dbb4-45b2-a72a-4a41e6bf598c {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 02:59:58.538827 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d7a111a5-6dc1-4030-adaf-661abcbcea71", "tag": "b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 02:59:58.539081 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-6833f077-dbb4-45b2-a72a-4a41e6bf598c {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 02:59:58.539492 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'tag': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd', 'status': 'completed', 'code': 200} Aug 24 02:59:58.560829 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 659513ab-6408-4e0e-b7d4-dea0216a385c details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 02:59:58.564684 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 706be5c2-c6fb-496a-ac91-104e4cc11ae7 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 02:59:58.746675 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 659513ab-6408-4e0e-b7d4-dea0216a385c, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=659513ab-6408-4e0e-b7d4-dea0216a385c,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:58.758486 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '659513ab-6408-4e0e-b7d4-dea0216a385c', 'network_id': '4091852f-86f8-4dac-87af-44624502a74d', 'port_id': '659513ab-6408-4e0e-b7d4-dea0216a385c', 'mac_address': 'fa:16:3e:b0:36:51', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 382, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4f536c4e-b790-4630-bdc6-867501285c32', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 02:59:58.769601 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1bab87d-4296-47e4-808e-8e810ffaa415 req-ccaf2a7d-227b-4f7b-b7f8-cd3bfb901745 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:58.771104 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c1bab87d-4296-47e4-808e-8e810ffaa415 req-ccaf2a7d-227b-4f7b-b7f8-cd3bfb901745 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 1099 time: 0.4588568 Aug 24 02:59:58.801788 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 706be5c2-c6fb-496a-ac91-104e4cc11ae7 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 02:59:58.809989 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:58.815915 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 706be5c2-c6fb-496a-ac91-104e4cc11ae7 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 02:59:58.816277 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:58.825956 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8da03cb7-49ef-4826-ba2b-be62e74e9440 service neutron] Pushing event updated for resources: {'Port': ['ID=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:58.846578 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c1bab87d-4296-47e4-808e-8e810ffaa415 req-4b74a04c-a9c4-4206-871e-fbfda875fc3e service neutron] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:58.850107 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e47405-51f8-4d0c-a82a-22748912d0bb admin admin] Pushing event updated for resources: {'Subnet': ['ID=08baa807-6f5d-4e59-891a-d1a97caf8fe9,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:58.851012 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 659513ab-6408-4e0e-b7d4-dea0216a385c {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 02:59:58.867372 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-130dab75-6b79-451a-98cf-19b0eaca61df req-f114a1d3-ce42-4329-9fb5-ddfa13dfa128 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3826702 Aug 24 02:59:58.884992 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 659513ab-6408-4e0e-b7d4-dea0216a385c, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=659513ab-6408-4e0e-b7d4-dea0216a385c,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:58.894607 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32e47405-51f8-4d0c-a82a-22748912d0bb admin admin] Checking segment: {'id': '9f912ca7-8981-46bc-8e03-7510f43d46b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 392, 'network_id': '8711ab0f-364a-4faf-b32f-902626cda653'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 02:59:58.895097 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32e47405-51f8-4d0c-a82a-22748912d0bb admin admin] Network hostable DHCP agents. Network: 8711ab0f-364a-4faf-b32f-902626cda653, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111276) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 02:59:58.917763 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2bfd44-629e-4b52-963a-b497c29fd745 req-c90053a2-82c2-4508-b6f0-37ced5c562b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:58.919545 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d2bfd44-629e-4b52-963a-b497c29fd745 req-c90053a2-82c2-4508-b6f0-37ced5c562b7 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 1097 time: 0.1693139 Aug 24 02:59:58.937625 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:58.968606 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:59.010695 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60032) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:59.011198 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 706be5c2-c6fb-496a-ac91-104e4cc11ae7, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=706be5c2-c6fb-496a-ac91-104e4cc11ae7,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 02:59:59.088943 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=659513ab-6408-4e0e-b7d4-dea0216a385c,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:59.104540 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32e47405-51f8-4d0c-a82a-22748912d0bb admin admin] Network 8711ab0f-364a-4faf-b32f-902626cda653 is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111276) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 02:59:59.153326 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-714015fb-ee8d-4557-8d40-f32684f8a656 req-1aaa2a02-5002-4610-9d22-0287afe548af tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:59.156713 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-714015fb-ee8d-4557-8d40-f32684f8a656 req-1aaa2a02-5002-4610-9d22-0287afe548af tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.1216044 Aug 24 02:59:59.168206 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2bfd44-629e-4b52-963a-b497c29fd745 req-5aefdf9f-fb13-41e5-bdb2-371d85f2af60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:59.169714 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d2bfd44-629e-4b52-963a-b497c29fd745 req-5aefdf9f-fb13-41e5-bdb2-371d85f2af60 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&shared=False HTTP/1.1" status: 200 len: 911 time: 0.2303884 Aug 24 02:59:59.194196 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c1bab87d-4296-47e4-808e-8e810ffaa415 req-4b74a04c-a9c4-4206-871e-fbfda875fc3e service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:59.219468 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-714015fb-ee8d-4557-8d40-f32684f8a656 req-40cd5b70-9495-4b86-9132-88d659361478 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0532436 Aug 24 02:59:59.238185 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:59.243492 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['659513ab-6408-4e0e-b7d4-dea0216a385c'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 02:59:59.252234 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e8920aa4-a16c-4c29-992b-88bf0c230bbd admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:59.298876 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2bfd44-629e-4b52-963a-b497c29fd745 req-ad8bede1-067a-4406-ba72-4576a0002a9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:59.300492 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d2bfd44-629e-4b52-963a-b497c29fd745 req-ad8bede1-067a-4406-ba72-4576a0002a9f service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1213708 Aug 24 02:59:59.302108 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-32e47405-51f8-4d0c-a82a-22748912d0bb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 8711ab0f-364a-4faf-b32f-902626cda653) {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 02:59:59.308077 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32e47405-51f8-4d0c-a82a-22748912d0bb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:59.309218 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-32e47405-51f8-4d0c-a82a-22748912d0bb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:59.316431 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4591478-2aaf-4162-9fd6-54bfe718ae9a None None] Network 8711ab0f-364a-4faf-b32f-902626cda653 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:59:59.371482 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c1bab87d-4296-47e4-808e-8e810ffaa415 req-4b74a04c-a9c4-4206-871e-fbfda875fc3e service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:59.381032 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=706be5c2-c6fb-496a-ac91-104e4cc11ae7,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:59.438664 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b74a04c-a9c4-4206-871e-fbfda875fc3e service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=6d726f65-5fbf-4c58-84d9-4640095927d5,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:59.466277 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c1bab87d-4296-47e4-808e-8e810ffaa415 req-4b74a04c-a9c4-4206-871e-fbfda875fc3e service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6825311 Aug 24 02:59:59.480119 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-b009e7f7-3647-48f9-bb21-df96e907fca8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:59.481751 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-b009e7f7-3647-48f9-bb21-df96e907fca8 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 1097 time: 0.1240237 Aug 24 02:59:59.493741 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-32e47405-51f8-4d0c-a82a-22748912d0bb admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 2.1453874 Aug 24 02:59:59.533764 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e646ee7a-ca3d-457f-9a88-0a14e42a7f02 None None] Network 8711ab0f-364a-4faf-b32f-902626cda653 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 02:59:59.630035 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e8920aa4-a16c-4c29-992b-88bf0c230bbd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:59.662297 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964eab79-94f0-46f8-a4cb-6ce817b92b13 req-a691bd96-26f9-4e5f-a93e-dd8a26c466d5 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:59.664079 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-964eab79-94f0-46f8-a4cb-6ce817b92b13 req-a691bd96-26f9-4e5f-a93e-dd8a26c466d5 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 944 time: 0.1079237 Aug 24 02:59:59.699591 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e8920aa4-a16c-4c29-992b-88bf0c230bbd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:59.738057 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-4083841d-98c8-4479-ba96-dffb009624b1 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd HTTP/1.1" status: 200 len: 217 time: 0.0555532 Aug 24 02:59:59.753176 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-e8920aa4-a16c-4c29-992b-88bf0c230bbd admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=e7116535b4d64168bc3d7c5c6024eca7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7406967 Aug 24 02:59:59.753963 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60072) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 02:59:59.754743 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8920aa4-a16c-4c29-992b-88bf0c230bbd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=080106e7-2219-4cac-9ad1-e25b2a481462,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 02:59:59.781815 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-964eab79-94f0-46f8-a4cb-6ce817b92b13 req-83daf266-0624-410f-ab10-0ae69f848b44 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1054273 Aug 24 02:59:59.802099 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-008ba046-4999-43cb-b64a-14ae2483a55b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:59.804102 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-008ba046-4999-43cb-b64a-14ae2483a55b service neutron] 10.222.0.43 "GET /v2.0/subnets?id=14102a94-a55b-43e1-a7a9-4210a4c2e2fb HTTP/1.1" status: 200 len: 849 time: 0.0576022 Aug 24 02:59:59.829694 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d70b9839-7c1e-4e00-8f39-0cb367e2d97a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:59.853917 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d70b9839-7c1e-4e00-8f39-0cb367e2d97a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 02:59:59.859700 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '89e6a64a-7412-4541-8c8b-5e9959ae0654', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '706be5c2-c6fb-496a-ac91-104e4cc11ae7'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 02:59:59.862839 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07e87540-0a56-4e5c-8002-6690886c2bd9" -d '{"events": [{"server_uuid": "89e6a64a-7412-4541-8c8b-5e9959ae0654", "name": "network-vif-plugged", "status": "completed", "tag": "706be5c2-c6fb-496a-ac91-104e4cc11ae7"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 02:59:59.872972 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-9bd495ad-9c9c-4a1b-8358-f62e5a420670 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 02:59:59.874646 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-9bd495ad-9c9c-4a1b-8358-f62e5a420670 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=f35e751d-f371-4788-abda-6a58b8a779df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0547190 Aug 24 02:59:59.907950 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 02:59:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1401fb8f-d2c0-4044-b768-b32f40daceed x-openstack-request-id: req-1401fb8f-d2c0-4044-b768-b32f40daceed {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 02:59:59.908624 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "89e6a64a-7412-4541-8c8b-5e9959ae0654", "name": "network-vif-plugged", "status": "completed", "tag": "706be5c2-c6fb-496a-ac91-104e4cc11ae7", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 02:59:59.908947 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-1401fb8f-d2c0-4044-b768-b32f40daceed {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 02:59:59.909431 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '89e6a64a-7412-4541-8c8b-5e9959ae0654', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '706be5c2-c6fb-496a-ac91-104e4cc11ae7', 'code': 200} Aug 24 03:00:00.012654 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d70b9839-7c1e-4e00-8f39-0cb367e2d97a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:00.016254 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d70b9839-7c1e-4e00-8f39-0cb367e2d97a admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:00.026155 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-d70b9839-7c1e-4e00-8f39-0cb367e2d97a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/080106e7-2219-4cac-9ad1-e25b2a481462 HTTP/1.1" status: 204 len: 168 time: 0.2601435 Aug 24 03:00:00.026632 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-85f64e9e-1423-4a4c-9873-298c3cbaef22 service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1407440 Aug 24 03:00:00.026860 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d70b9839-7c1e-4e00-8f39-0cb367e2d97a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=080106e7-2219-4cac-9ad1-e25b2a481462,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:00.051715 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fd529ea-dd73-45ce-a5a8-b28988c22a19 req-39bba648-8d70-43b9-856e-5c8664b44de4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:00.053161 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1fd529ea-dd73-45ce-a5a8-b28988c22a19 req-39bba648-8d70-43b9-856e-5c8664b44de4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 944 time: 0.0715151 Aug 24 03:00:00.131879 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1fd529ea-dd73-45ce-a5a8-b28988c22a19 req-4a435bc6-dfe5-4c54-8c43-5f24e9ce6ffd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677998 Aug 24 03:00:00.163581 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3967ea6-7198-473b-860c-7fc92c2bd164 req-7977c5c4-9ae4-4066-b7b8-63a97d3d1566 service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1265364 Aug 24 03:00:00.323480 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb1ff2e-990d-4ce6-8e4e-ea5d1f4d628e req-88645371-2120-43ef-8001-3af8040ef8b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:00.324965 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8bb1ff2e-990d-4ce6-8e4e-ea5d1f4d628e req-88645371-2120-43ef-8001-3af8040ef8b7 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 1098 time: 0.0538895 Aug 24 03:00:00.361646 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8bb1ff2e-990d-4ce6-8e4e-ea5d1f4d628e req-d170a14a-be36-4b64-8962-8cfabbfeaea3 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0286567 Aug 24 03:00:00.372086 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca773633-7e68-4fb1-874a-53381d7b0078 req-b6246071-ee9a-40a1-a45b-2383fe4760da tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:00.373582 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ca773633-7e68-4fb1-874a-53381d7b0078 req-b6246071-ee9a-40a1-a45b-2383fe4760da tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.0488970 Aug 24 03:00:00.410804 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ca773633-7e68-4fb1-874a-53381d7b0078 req-72af7a78-d72b-46fd-8903-906dd2df0446 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313005 Aug 24 03:00:00.560790 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 659513ab-6408-4e0e-b7d4-dea0216a385c up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:00:00.673265 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 659513ab-6408-4e0e-b7d4-dea0216a385c completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:00:00.677459 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 659513ab-6408-4e0e-b7d4-dea0216a385c triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:00.685815 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:00.708121 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60118) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:00.713369 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-509547129-network', 'tenant_id': '334c1afc7d2a48dfba08cda062bc7b0a'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:00.765769 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:00.800957 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 659513ab-6408-4e0e-b7d4-dea0216a385c, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=659513ab-6408-4e0e-b7d4-dea0216a385c,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:00.814768 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Made reservation on behalf of 334c1afc7d2a48dfba08cda062bc7b0a for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:00:00.818409 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:00.827760 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:00.887670 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:00.931447 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b40a304-bfb6-49c9-a400-7921a11f6258 req-8dca1f13-2b21-497c-b004-f4fe3541b35c tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:00.932972 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7b40a304-bfb6-49c9-a400-7921a11f6258 req-8dca1f13-2b21-497c-b004-f4fe3541b35c tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 944 time: 0.0779414 Aug 24 03:00:00.943731 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=659513ab-6408-4e0e-b7d4-dea0216a385c,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:00.953475 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:00.973618 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7b40a304-bfb6-49c9-a400-7921a11f6258 req-f6e7d7a2-2429-48be-9d85-001ef830b9b2 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0333538 Aug 24 03:00:01.063412 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:01.099826 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] vlan segment allocate from pool success with {'vlan_id': 381, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:00:01.110943 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df49618c-023f-4c99-b80b-5683ebb90276,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:01.114975 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:01.115757 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Added segment 4aa4979d-dda2-4b18-bdcb-03c331781325 of type vlan for network 00da3521-1685-44fa-85bf-01e14adede93 Aug 24 03:00:01.157548 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:01.262942 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-253087b6-4f83-4777-ac5f-737640aabd30 req-72688cf7-e709-4dfd-b5d8-733bd101b403 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:01.264611 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-253087b6-4f83-4777-ac5f-737640aabd30 req-72688cf7-e709-4dfd-b5d8-733bd101b403 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0573928 Aug 24 03:00:01.314445 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-253087b6-4f83-4777-ac5f-737640aabd30 req-98e5abcb-e956-46bf-8272-a4ff59b8a3a0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435357 Aug 24 03:00:01.329259 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:01.330479 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:01.330988 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:01.396974 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] Pushing event updated for resources: {'Network': ['ID=00da3521-1685-44fa-85bf-01e14adede93,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:01.407798 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 00da3521-1685-44fa-85bf-01e14adede93 details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:00:01.454781 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-d8f8b89d-641e-4c50-b9fa-fdb4a8eafdd2 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.7455435 Aug 24 03:00:01.457463 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60160) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:01.462717 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-179c9ddb-1834-4551-a4bd-505040c071d2 admin admin] Request body: {'subnet': {'network_id': '00da3521-1685-44fa-85bf-01e14adede93', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-509547129-subnet', 'tenant_id': '334c1afc7d2a48dfba08cda062bc7b0a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:01.560171 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60168) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:01.564325 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-513ed173-a5e3-49f6-8911-b3a8a956c631 req-fa37c733-36f7-4ce0-a104-b8868f0c98c5 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:01.572816 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-513ed173-a5e3-49f6-8911-b3a8a956c631 req-fa37c733-36f7-4ce0-a104-b8868f0c98c5 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.0744061 Aug 24 03:00:01.620150 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-179c9ddb-1834-4551-a4bd-505040c071d2 admin admin] Made reservation on behalf of 334c1afc7d2a48dfba08cda062bc7b0a for: {'subnet': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:00:01.623799 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-179c9ddb-1834-4551-a4bd-505040c071d2 admin admin] Notify callbacks [] for subnet, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:01.651451 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-513ed173-a5e3-49f6-8911-b3a8a956c631 req-7de1f078-9570-4000-9aaa-e4ceb0263f9b tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0781617 Aug 24 03:00:01.720077 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1475525775-network', 'tenant_id': '3b289da7de434e9ca4c67edc2769c6ab'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:01.825547 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Made reservation on behalf of 3b289da7de434e9ca4c67edc2769c6ab for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:00:01.827763 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:01.843479 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:01.910205 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cd5b8f9e-cb7a-4828-b977-8189ee4a6aef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '659513ab-6408-4e0e-b7d4-dea0216a385c'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:00:01.913061 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ceffb96d-262c-4e79-8bd8-8e73801c94b9" -d '{"events": [{"server_uuid": "cd5b8f9e-cb7a-4828-b977-8189ee4a6aef", "name": "network-vif-plugged", "status": "completed", "tag": "659513ab-6408-4e0e-b7d4-dea0216a385c"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:00:01.950175 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:00:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b740ee39-9b77-4906-b0f2-1cd4b916ffba x-openstack-request-id: req-b740ee39-9b77-4906-b0f2-1cd4b916ffba {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:00:01.950474 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cd5b8f9e-cb7a-4828-b977-8189ee4a6aef", "name": "network-vif-plugged", "status": "completed", "tag": "659513ab-6408-4e0e-b7d4-dea0216a385c", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:00:01.950727 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b740ee39-9b77-4906-b0f2-1cd4b916ffba {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:00:01.951129 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cd5b8f9e-cb7a-4828-b977-8189ee4a6aef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '659513ab-6408-4e0e-b7d4-dea0216a385c', 'code': 200} Aug 24 03:00:01.953005 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-179c9ddb-1834-4551-a4bd-505040c071d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for subnet, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:01.985032 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:02.015951 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-179c9ddb-1834-4551-a4bd-505040c071d2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f63f4481-6f72-4deb-a46b-57b510710e85,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:02.027725 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-179c9ddb-1834-4551-a4bd-505040c071d2 admin admin] Checking segment: {'id': '4aa4979d-dda2-4b18-bdcb-03c331781325', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '00da3521-1685-44fa-85bf-01e14adede93'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:00:02.027725 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-179c9ddb-1834-4551-a4bd-505040c071d2 admin admin] Network hostable DHCP agents. Network: 00da3521-1685-44fa-85bf-01e14adede93, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111275) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:00:02.082182 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:02.104764 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] vlan segment allocate from pool success with {'vlan_id': 361, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:00:02.107979 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ed86b2-9440-4e70-8166-22a84eb35680 req-1e1bfd02-1b63-4cdc-aac4-99d57ea2d3c4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:02.109648 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-80ed86b2-9440-4e70-8166-22a84eb35680 req-1e1bfd02-1b63-4cdc-aac4-99d57ea2d3c4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 944 time: 0.0512335 Aug 24 03:00:02.123166 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4b4030d-36ff-4ec4-a865-deeb8b403f2e,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:02.126679 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:02.127027 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Added segment 8153f8c3-eca4-496c-bd4f-59ba0022c639 of type vlan for network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee Aug 24 03:00:02.143754 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-179c9ddb-1834-4551-a4bd-505040c071d2 admin admin] Network 00da3521-1685-44fa-85bf-01e14adede93 is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111275) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:00:02.169278 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-80ed86b2-9440-4e70-8166-22a84eb35680 req-014c809e-43c5-4a0f-a215-faa8baa3b7b1 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0506611 Aug 24 03:00:02.189703 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:02.275894 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-179c9ddb-1834-4551-a4bd-505040c071d2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 00da3521-1685-44fa-85bf-01e14adede93) {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:00:02.277246 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:02.278441 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:02.278887 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f947290-32eb-4ef1-83a7-e128e56f4295 None None] Network 00da3521-1685-44fa-85bf-01e14adede93 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:00:02.279150 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:02.335361 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a00b40-d632-4d5a-a558-1f8000981c1e req-31e21e16-7647-48aa-8a62-4e9db423bfa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:02.336954 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c4a00b40-d632-4d5a-a558-1f8000981c1e req-31e21e16-7647-48aa-8a62-4e9db423bfa2 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 1098 time: 0.0522046 Aug 24 03:00:02.341043 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-179c9ddb-1834-4551-a4bd-505040c071d2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:02.341509 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-179c9ddb-1834-4551-a4bd-505040c071d2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:02.366473 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] Pushing event updated for resources: {'Network': ['ID=f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:02.384550 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c4a00b40-d632-4d5a-a558-1f8000981c1e req-62c6563b-2cdd-4963-ba7e-2dbfdf6d2535 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398583 Aug 24 03:00:02.392655 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:00:02.432867 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 60202) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:02.437304 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-9b0a484c-7310-4984-840f-cc0126337867 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.8716466 Aug 24 03:00:02.440731 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-677e68f1-4540-41da-8349-2f44756168f8 admin admin] Request body: {'subnet': {'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1475525775-subnet', 'tenant_id': '3b289da7de434e9ca4c67edc2769c6ab', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:02.454426 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3fc26d8-63de-4d08-a648-d925202a0998 None None] Network 00da3521-1685-44fa-85bf-01e14adede93 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:00:02.458030 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8133214-ffcb-43f6-a9f2-ca0688f60ede req-a1ab4162-c52b-4b4f-a74f-97e11fb69be5 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:02.459542 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f8133214-ffcb-43f6-a9f2-ca0688f60ede req-a1ab4162-c52b-4b4f-a74f-97e11fb69be5 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0658083 Aug 24 03:00:02.501647 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-179c9ddb-1834-4551-a4bd-505040c071d2 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.0374210 Aug 24 03:00:02.511949 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f8133214-ffcb-43f6-a9f2-ca0688f60ede req-626da11e-41ca-4487-a5b3-cf5ce4f52fe2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453887 Aug 24 03:00:02.579040 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:00:02.630504 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-677e68f1-4540-41da-8349-2f44756168f8 admin admin] Made reservation on behalf of 3b289da7de434e9ca4c67edc2769c6ab for: {'subnet': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:00:02.632815 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-677e68f1-4540-41da-8349-2f44756168f8 admin admin] Notify callbacks [] for subnet, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:02.702508 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:02.715812 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'port_id': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd', 'mac_address': 'fa:16:3e:fd:ae:35', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 355, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:00:02.756209 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:02.769793 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:00:02.790623 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:02.815808 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da002588-6fd0-4071-81a3-9466a8165b2b req-d8a46e08-0338-431d-a96c-9a998fd3fc8e tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:02.817272 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-da002588-6fd0-4071-81a3-9466a8165b2b req-d8a46e08-0338-431d-a96c-9a998fd3fc8e tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.0888817 Aug 24 03:00:02.890425 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-da002588-6fd0-4071-81a3-9466a8165b2b req-dbf4884f-9168-420e-b57d-1374a2e56f79 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483627 Aug 24 03:00:02.905185 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:02.953157 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:02.968419 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-677e68f1-4540-41da-8349-2f44756168f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for subnet, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:03.031586 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-677e68f1-4540-41da-8349-2f44756168f8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fbe73e0e-d251-4e49-99f9-e952356c2e56,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:03.040137 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-677e68f1-4540-41da-8349-2f44756168f8 admin admin] Checking segment: {'id': '8153f8c3-eca4-496c-bd4f-59ba0022c639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:00:03.040593 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-677e68f1-4540-41da-8349-2f44756168f8 admin admin] Network hostable DHCP agents. Network: f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111276) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:00:03.151510 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:00:03.264956 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-677e68f1-4540-41da-8349-2f44756168f8 admin admin] Network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111276) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:00:03.293150 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-338c9d3f-2867-4f5a-8a70-0a7f43576191 req-e3b874d1-8001-4c55-97cb-94183c116497 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:03.294712 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-338c9d3f-2867-4f5a-8a70-0a7f43576191 req-e3b874d1-8001-4c55-97cb-94183c116497 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 945 time: 0.0593483 Aug 24 03:00:03.346847 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-338c9d3f-2867-4f5a-8a70-0a7f43576191 req-f1be8a2b-2d10-406d-98b3-bae5f78bdb43 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454137 Aug 24 03:00:03.503073 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-677e68f1-4540-41da-8349-2f44756168f8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee) {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:00:03.506858 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-677e68f1-4540-41da-8349-2f44756168f8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:03.507447 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-677e68f1-4540-41da-8349-2f44756168f8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:03.512724 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58acc098-2614-47e8-ba0f-a31bb2830558 None None] Network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:00:03.637872 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e619ee0-01bd-4236-a7e9-f09c61338a28 None None] Network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:00:03.647752 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee60ae8-f8ab-4912-9701-48f02bdda0a8 req-907dff20-e512-407e-aae7-c3660cc355b0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:03.649927 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3ee60ae8-f8ab-4912-9701-48f02bdda0a8 req-907dff20-e512-407e-aae7-c3660cc355b0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0582333 Aug 24 03:00:03.688888 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3ee60ae8-f8ab-4912-9701-48f02bdda0a8 req-b923e46f-005c-4a78-bbf6-cb945134f7cd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323572 Aug 24 03:00:03.690485 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-677e68f1-4540-41da-8349-2f44756168f8 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.2565310 Aug 24 03:00:04.464636 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e57843-441b-4633-993b-3f3249759834 req-47d3e471-b77d-478b-b462-5775c605ce3d tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:04.467400 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d6e57843-441b-4633-993b-3f3249759834 req-47d3e471-b77d-478b-b462-5775c605ce3d tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 945 time: 0.0516207 Aug 24 03:00:04.502362 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d6e57843-441b-4633-993b-3f3249759834 req-ad232342-95a2-4725-b515-429b7660daf6 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303092 Aug 24 03:00:04.580746 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:00:04.808003 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:00:04.817320 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:04.817320 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:04.817513 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb87a66a-f4a4-4cf4-8b29-23deb2bbe3f3 req-a9627e3a-338f-441e-9651-5a0a82d19789 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:04.817513 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb87a66a-f4a4-4cf4-8b29-23deb2bbe3f3 req-a9627e3a-338f-441e-9651-5a0a82d19789 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0527329 Aug 24 03:00:04.857451 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb87a66a-f4a4-4cf4-8b29-23deb2bbe3f3 req-6d3dce25-3898-4872-accb-cc92ae5b973e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344386 Aug 24 03:00:04.891697 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:04.915085 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:00:04.917421 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0fcfdcde-bb9a-41bd-81c3-8c0d4d2e112d" -d '{"events": [{"server_uuid": "d7a111a5-6dc1-4030-adaf-661abcbcea71", "name": "network-vif-plugged", "status": "completed", "tag": "b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:00:04.930567 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:04.960615 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:00:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe8d1a2d-90cf-4de8-9e0d-a4ae16bc5816 x-openstack-request-id: req-fe8d1a2d-90cf-4de8-9e0d-a4ae16bc5816 {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:00:04.960615 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d7a111a5-6dc1-4030-adaf-661abcbcea71", "name": "network-vif-plugged", "status": "completed", "tag": "b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:00:04.960615 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-fe8d1a2d-90cf-4de8-9e0d-a4ae16bc5816 {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:00:04.960615 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd', 'code': 200} Aug 24 03:00:05.053707 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:05.119901 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:05.390052 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a22bca99-b2cf-42ce-8508-2eda373a18b9 req-c7f50ee8-7af6-44a6-a50e-3afc0982a5f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:05.390052 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a22bca99-b2cf-42ce-8508-2eda373a18b9 req-c7f50ee8-7af6-44a6-a50e-3afc0982a5f8 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 1099 time: 0.0477729 Aug 24 03:00:05.410449 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a22bca99-b2cf-42ce-8508-2eda373a18b9 req-e55dcecf-fb57-4a46-bd4f-a37b463b6efa service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0279536 Aug 24 03:00:05.646326 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62bd19bc-daaf-4f6a-b223-d368b23c2a30 req-86311a96-c4a9-4f5c-a309-998304a46217 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:05.648002 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-62bd19bc-daaf-4f6a-b223-d368b23c2a30 req-86311a96-c4a9-4f5c-a309-998304a46217 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0689666 Aug 24 03:00:05.681824 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e96c2fc8-01d4-416c-9ded-e809fb1a8884 req-0f2cbc45-ac87-4623-b61b-c9228d99ea11 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:05.683364 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e96c2fc8-01d4-416c-9ded-e809fb1a8884 req-0f2cbc45-ac87-4623-b61b-c9228d99ea11 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0643902 Aug 24 03:00:05.692272 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-62bd19bc-daaf-4f6a-b223-d368b23c2a30 req-5a2737f3-8872-42cb-b49c-8fdb610bbb85 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0353129 Aug 24 03:00:05.722286 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e96c2fc8-01d4-416c-9ded-e809fb1a8884 req-b47f4d70-4f48-432e-bdce-16506af4139c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325069 Aug 24 03:00:05.830473 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694a697c-320b-4ee7-9f1f-c6645046929b req-432ed80f-9a88-4c53-93b0-6848f798be1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:05.832120 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-694a697c-320b-4ee7-9f1f-c6645046929b req-432ed80f-9a88-4c53-93b0-6848f798be1b service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 1098 time: 0.0440459 Aug 24 03:00:05.959228 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694a697c-320b-4ee7-9f1f-c6645046929b req-6a97ee77-8a05-495a-99fa-26fdc3092c16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:05.960648 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-694a697c-320b-4ee7-9f1f-c6645046929b req-6a97ee77-8a05-495a-99fa-26fdc3092c16 service neutron] 10.222.0.43 "GET /v2.0/networks?id=4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 200 len: 919 time: 0.0868754 Aug 24 03:00:06.005937 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-694a697c-320b-4ee7-9f1f-c6645046929b req-7c5e3e67-2a28-4ce7-bb09-b05f8f7ba332 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=659513ab-6408-4e0e-b7d4-dea0216a385c HTTP/1.1" status: 200 len: 217 time: 0.0382037 Aug 24 03:00:06.059626 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694a697c-320b-4ee7-9f1f-c6645046929b req-1017fa53-ef98-47d4-b621-203cbddd7b66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:06.061563 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-694a697c-320b-4ee7-9f1f-c6645046929b req-1017fa53-ef98-47d4-b621-203cbddd7b66 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4f536c4e-b790-4630-bdc6-867501285c32 HTTP/1.1" status: 200 len: 858 time: 0.0483932 Aug 24 03:00:06.097559 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-694a697c-320b-4ee7-9f1f-c6645046929b req-f169c267-74d7-4ab5-b531-ea1428bb0085 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=4091852f-86f8-4dac-87af-44624502a74d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0252097 Aug 24 03:00:06.212886 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-694a697c-320b-4ee7-9f1f-c6645046929b req-19aaa291-3338-43d1-9f05-bc48dc914e0c service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0938389 Aug 24 03:00:06.293197 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-694a697c-320b-4ee7-9f1f-c6645046929b req-67fb7f2a-dcfd-4632-8693-643e3274123e service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866621 Aug 24 03:00:06.817280 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e62a3f57-387a-4856-b974-dd1c11f27f61 req-e12252b5-579a-4027-ae8b-531a589a1762 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:06.819001 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e62a3f57-387a-4856-b974-dd1c11f27f61 req-e12252b5-579a-4027-ae8b-531a589a1762 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0551803 Aug 24 03:00:06.867370 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e62a3f57-387a-4856-b974-dd1c11f27f61 req-273e041e-c42a-4eca-8998-ad2c66852dd9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397365 Aug 24 03:00:06.987392 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-498d8602-1470-4b73-add9-f73a49912f4e req-a063fd7e-2ea2-490a-98f5-2edab2d6febf tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:06.988847 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-498d8602-1470-4b73-add9-f73a49912f4e req-a063fd7e-2ea2-490a-98f5-2edab2d6febf tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0492771 Aug 24 03:00:07.027025 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-498d8602-1470-4b73-add9-f73a49912f4e req-0921e9c3-f418-47c0-b691-d0a76d6e9add tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311880 Aug 24 03:00:07.218449 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-5c2d3b50-f8cd-411f-9fef-ccc7709f3464 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:07.227268 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-5c2d3b50-f8cd-411f-9fef-ccc7709f3464 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/networks?id=f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee HTTP/1.1" status: 200 len: 814 time: 0.1186566 Aug 24 03:00:07.235594 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-68cfceac-4c50-4b05-8977-593da8b15239 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/quotas/3b289da7de434e9ca4c67edc2769c6ab HTTP/1.1" status: 200 len: 375 time: 0.0100751 Aug 24 03:00:07.270761 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-ded1419a-7e09-401e-be4d-d250878d6a22 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=3b289da7de434e9ca4c67edc2769c6ab&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0295255 Aug 24 03:00:07.361159 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-1fe020e2-3ca5-497c-81ad-423db1c6fe44 service neutron] 10.222.0.30 "GET /v2.0/networks/f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824690 Aug 24 03:00:07.452918 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-29c4a788-90b7-4982-a4ea-6ed206503add service neutron] 10.222.0.30 "GET /v2.0/networks/f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856342 Aug 24 03:00:07.690273 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:07.768054 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8b74bb32-278d-43a0-a13e-cf1935e6358b req-39df792b-ab32-4141-ac09-fcdafcc8c117 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 210 time: 0.0272987 Aug 24 03:00:07.984940 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-963bb3b3-02bd-43a4-802c-84686b5da26c req-96eddd70-5747-48c3-81f7-203259929e83 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:07.988863 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-963bb3b3-02bd-43a4-802c-84686b5da26c req-96eddd70-5747-48c3-81f7-203259929e83 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0495346 Aug 24 03:00:08.024381 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-963bb3b3-02bd-43a4-802c-84686b5da26c req-102fec6f-7a38-4aba-b102-bc02d14c50e9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312703 Aug 24 03:00:08.136568 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71487dae-5c8b-4102-8dcd-7f3d10d7a4cd req-0c4a3bf2-eb2c-4c01-ba43-39d1041ef78c tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:08.138125 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-71487dae-5c8b-4102-8dcd-7f3d10d7a4cd req-0c4a3bf2-eb2c-4c01-ba43-39d1041ef78c tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0476992 Aug 24 03:00:08.146784 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60388) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:08.151479 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-31f3e0bc-0ac4-497a-84df-9b6296eab2bf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Request body: {'floatingip': {'port_id': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:08.392137 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-31f3e0bc-0ac4-497a-84df-9b6296eab2bf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:08.538340 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4921e2f8-9da7-4b2a-b290-b5085b4934f7 req-c37b57c2-b27e-4a4a-a622-493c2abdd4e0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:08.540843 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4921e2f8-9da7-4b2a-b290-b5085b4934f7 req-c37b57c2-b27e-4a4a-a622-493c2abdd4e0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.1756234 Aug 24 03:00:08.638069 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4921e2f8-9da7-4b2a-b290-b5085b4934f7 req-614877ee-0290-41a1-98db-84b6582e0817 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0875199 Aug 24 03:00:08.869835 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d8ab1bd8-0dca-4f85-9562-01d45513dd85 req-3c828805-1a5c-4e92-9a9e-e06e9c8b86ca tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 210 time: 0.0416176 Aug 24 03:00:09.131694 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-31f3e0bc-0ac4-497a-84df-9b6296eab2bf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:09.327704 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-31f3e0bc-0ac4-497a-84df-9b6296eab2bf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:09.427371 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.l3_db [None req-31f3e0bc-0ac4-497a-84df-9b6296eab2bf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Floating IP fec6f3c0-dff8-42a4-ac0a-99b41100efe5 associated. External IP: 172.27.2.141, port: b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd. Aug 24 03:00:09.703903 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-31f3e0bc-0ac4-497a-84df-9b6296eab2bf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Router 893a8671-6102-43da-9368-0f66640f4cf7 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:00:09.776361 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4332dad-1a5e-42fa-812c-5f1f519cd974 req-a4fe6b61-6706-45f8-9e3b-9479851155d3 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:09.778636 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c4332dad-1a5e-42fa-812c-5f1f519cd974 req-a4fe6b61-6706-45f8-9e3b-9479851155d3 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0523403 Aug 24 03:00:09.827177 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c4332dad-1a5e-42fa-812c-5f1f519cd974 req-81be46aa-16f3-4a49-944c-884706310e09 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421669 Aug 24 03:00:09.996656 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31f3e0bc-0ac4-497a-84df-9b6296eab2bf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:00:10.013800 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-31f3e0bc-0ac4-497a-84df-9b6296eab2bf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:10.017068 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-af7b212f-9a70-49d6-a43b-863d844557ee req-cf843fab-48fe-484f-866a-d4b950160709 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 210 time: 0.0338535 Aug 24 03:00:10.024237 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0853a9e5-0799-44fa-a875-3f1c780e9354 None None] Sync routers for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:00:10.042784 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0853a9e5-0799-44fa-a875-3f1c780e9354 None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:00:10.043491 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-0853a9e5-0799-44fa-a875-3f1c780e9354 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:59:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:10.060567 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-31f3e0bc-0ac4-497a-84df-9b6296eab2bf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "PUT /v2.0/floatingips/fec6f3c0-dff8-42a4-ac0a-99b41100efe5 HTTP/1.1" status: 200 len: 992 time: 1.9127257 Aug 24 03:00:10.061250 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'tag': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:00:10.064388 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b483c55-eac4-4a6e-b937-9bcb827a9708" -d '{"events": [{"name": "network-changed", "server_uuid": "d7a111a5-6dc1-4030-adaf-661abcbcea71", "tag": "b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:00:10.107000 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:00:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd4ebcad-5a5e-4298-8c00-f3bc42b062b6 x-openstack-request-id: req-cd4ebcad-5a5e-4298-8c00-f3bc42b062b6 {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:00:10.107000 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d7a111a5-6dc1-4030-adaf-661abcbcea71", "tag": "b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:00:10.107000 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cd4ebcad-5a5e-4298-8c00-f3bc42b062b6 {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:00:10.107000 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'tag': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd', 'status': 'completed', 'code': 200} Aug 24 03:00:10.175439 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b483c55-eac4-4a6e-b937-9bcb827a9708 req-4bdaeba9-8c29-4b43-bd0c-1fcdca88da36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:10.177032 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2b483c55-eac4-4a6e-b937-9bcb827a9708 req-4bdaeba9-8c29-4b43-bd0c-1fcdca88da36 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 1099 time: 0.0477939 Aug 24 03:00:10.207381 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-0853a9e5-0799-44fa-a875-3f1c780e9354 None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:00:10.220768 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60450) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:10.280428 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b483c55-eac4-4a6e-b937-9bcb827a9708 req-52a379a8-6346-4a53-803b-469c76b3e3ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:10.282452 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2b483c55-eac4-4a6e-b937-9bcb827a9708 req-52a379a8-6346-4a53-803b-469c76b3e3ad service neutron] 10.222.0.43 "GET /v2.0/networks?id=f35e751d-f371-4788-abda-6a58b8a779df HTTP/1.1" status: 200 len: 911 time: 0.0981846 Aug 24 03:00:10.338465 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9e7a096d-b5be-43e3-9167-a2f42854e5ab admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:10.406953 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2b483c55-eac4-4a6e-b937-9bcb827a9708 req-35735269-fb22-46f1-bf52-02d0681d0cfd service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd HTTP/1.1" status: 200 len: 1000 time: 0.1170950 Aug 24 03:00:10.450522 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9e7a096d-b5be-43e3-9167-a2f42854e5ab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:10.489743 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b483c55-eac4-4a6e-b937-9bcb827a9708 req-b0d98c73-c283-480b-b1c3-dccf65e7496b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:10.491362 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2b483c55-eac4-4a6e-b937-9bcb827a9708 req-b0d98c73-c283-480b-b1c3-dccf65e7496b service neutron] 10.222.0.43 "GET /v2.0/subnets?id=14102a94-a55b-43e1-a7a9-4210a4c2e2fb HTTP/1.1" status: 200 len: 849 time: 0.0777605 Aug 24 03:00:10.569122 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b483c55-eac4-4a6e-b937-9bcb827a9708 req-52c3e4b8-cbc2-4f72-9d58-bb41a13805f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:10.574401 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2b483c55-eac4-4a6e-b937-9bcb827a9708 req-52c3e4b8-cbc2-4f72-9d58-bb41a13805f6 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=f35e751d-f371-4788-abda-6a58b8a779df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0755208 Aug 24 03:00:10.580524 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9e7a096d-b5be-43e3-9167-a2f42854e5ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:10.658149 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-9e7a096d-b5be-43e3-9167-a2f42854e5ab admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=589b87a25522430e8b2558c61e0ec32a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4362993 Aug 24 03:00:10.661170 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60470) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:10.664860 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-0853a9e5-0799-44fa-a875-3f1c780e9354 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'fec6f3c0-dff8-42a4-ac0a-99b41100efe5', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'floating_ip_address': '172.27.2.141', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'port_id': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 119, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'mac_address': 'fa:16:3e:fd:ae:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T02:59:45Z', 'updated_at': '2021-08-24T03:00:08Z', 'revision_number': 1, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:43Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:10.669695 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e7a096d-b5be-43e3-9167-a2f42854e5ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=194c8773-1205-4e57-8f2a-83b15c0dc34e,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:10.717290 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0853a9e5-0799-44fa-a875-3f1c780e9354 None None] Checking router: 893a8671-6102-43da-9368-0f66640f4cf7 for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:00:10.731734 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0853a9e5-0799-44fa-a875-3f1c780e9354 None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:00:10.731734 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-0853a9e5-0799-44fa-a875-3f1c780e9354 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T02:59:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:10.748636 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8d3501a5-1c44-4c40-81f1-4da30f55e63b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:10.749924 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2b483c55-eac4-4a6e-b937-9bcb827a9708 req-0f90d9f7-599b-4193-b1dd-f92d4edc0094 service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1668983 Aug 24 03:00:10.775876 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8d3501a5-1c44-4c40-81f1-4da30f55e63b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:10.858037 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-0853a9e5-0799-44fa-a875-3f1c780e9354 None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:00:10.872486 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2b483c55-eac4-4a6e-b937-9bcb827a9708 req-321ef032-5a32-4341-93f2-b930034b1148 service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1130068 Aug 24 03:00:10.955955 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-870f4b0d-5cff-4f14-ab63-68192a7d2ce4 req-74721164-2467-44f0-bcaf-d11f84222b1c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:10.957439 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-870f4b0d-5cff-4f14-ab63-68192a7d2ce4 req-74721164-2467-44f0-bcaf-d11f84222b1c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0518439 Aug 24 03:00:10.994792 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-870f4b0d-5cff-4f14-ab63-68192a7d2ce4 req-69f0f60b-d220-4307-9a3f-7641c0cc8727 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310647 Aug 24 03:00:11.012598 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8d3501a5-1c44-4c40-81f1-4da30f55e63b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:11.015383 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8d3501a5-1c44-4c40-81f1-4da30f55e63b admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:11.016577 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-8d3501a5-1c44-4c40-81f1-4da30f55e63b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/194c8773-1205-4e57-8f2a-83b15c0dc34e HTTP/1.1" status: 204 len: 168 time: 0.3539445 Aug 24 03:00:11.024801 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d3501a5-1c44-4c40-81f1-4da30f55e63b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=194c8773-1205-4e57-8f2a-83b15c0dc34e,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:11.105811 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-0853a9e5-0799-44fa-a875-3f1c780e9354 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'fec6f3c0-dff8-42a4-ac0a-99b41100efe5', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'floating_ip_address': '172.27.2.141', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'port_id': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 119, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'mac_address': 'fa:16:3e:fd:ae:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T02:59:45Z', 'updated_at': '2021-08-24T03:00:08Z', 'revision_number': 1, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:43Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:11.133978 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0853a9e5-0799-44fa-a875-3f1c780e9354 None None] The sync data for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi is: [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'fec6f3c0-dff8-42a4-ac0a-99b41100efe5', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'floating_ip_address': '172.27.2.141', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'port_id': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 119, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'mac_address': 'fa:16:3e:fd:ae:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T02:59:45Z', 'updated_at': '2021-08-24T03:00:08Z', 'revision_number': 1, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:43Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:00:11.134853 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bf59434f-b7e3-4c74-85fc-3e835e2917cc req-70c697cd-27f5-4538-95e1-7d603170f579 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 210 time: 0.0286567 Aug 24 03:00:11.364421 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67538bb3-135e-4be6-80e4-a6be9f4a11c2 None None] New status for floating IP fec6f3c0-dff8-42a4-ac0a-99b41100efe5: ACTIVE {{(pid=111277) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:00:11.463102 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-e8217f78-0217-4de1-8c81-d841118f25a1 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:11.464555 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-e8217f78-0217-4de1-8c81-d841118f25a1 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.43 "GET /v2.0/networks?id=f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee HTTP/1.1" status: 200 len: 814 time: 0.1289678 Aug 24 03:00:11.480913 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Request body: {'port': {'device_id': '0289ba5c-5475-4c85-ab70-6d9571a8d345', 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee', 'admin_state_up': True, 'tenant_id': '3b289da7de434e9ca4c67edc2769c6ab'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:11.702047 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Made reservation on behalf of 3b289da7de434e9ca4c67edc2769c6ab for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:00:11.711722 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:11.841069 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Allocated IP 172.20.0.9 (f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee/fbe73e0e-d251-4e49-99f9-e952356c2e56/1022b7c2-e212-4c0a-845d-686500aef4ef) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:00:12.000707 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:12.111231 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-434f1bbd-4765-47a6-bec9-504fd0f88615 req-1f85ef1a-da58-492f-960a-dd52b17b14ff tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:12.112699 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-434f1bbd-4765-47a6-bec9-504fd0f88615 req-1f85ef1a-da58-492f-960a-dd52b17b14ff tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0480578 Aug 24 03:00:12.151480 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-434f1bbd-4765-47a6-bec9-504fd0f88615 req-ba5e8c38-15d8-48ff-8e94-5ec4bee57ba1 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323207 Aug 24 03:00:12.235287 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:12.241111 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-50f59cda-223c-4ba5-831f-5ac2c85283db req-ddfa234a-5ad8-4c3c-b78b-228bbb47c454 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 210 time: 0.0254498 Aug 24 03:00:12.255466 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60512) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:12.270263 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-36adcc9e-5668-4dc4-a6ca-f34eab702ea4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:12.368903 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-36adcc9e-5668-4dc4-a6ca-f34eab702ea4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:12.464808 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-36adcc9e-5668-4dc4-a6ca-f34eab702ea4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:12.474314 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:00:12.477492 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:00:12.481384 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:00:12.487095 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:12.487750 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:12.504853 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Pushing event updated for resources: {'Port': ['ID=1022b7c2-e212-4c0a-845d-686500aef4ef,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:12.517037 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36adcc9e-5668-4dc4-a6ca-f34eab702ea4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a6a3657-a36a-48b5-891d-bae201decd83,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:12.528546 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-36adcc9e-5668-4dc4-a6ca-f34eab702ea4 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=130dfce012594677a7de83341068e97e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2720439 Aug 24 03:00:12.531009 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60520) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:12.578766 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4f9c0fd0-8724-4f21-9484-0b6e2492a2df admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:12.597357 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-79cb39dc-0344-448d-b818-820c3d5fdb61 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1209636 Aug 24 03:00:12.600553 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4f9c0fd0-8724-4f21-9484-0b6e2492a2df admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:12.609935 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Request body: {'port': {'device_id': '0289ba5c-5475-4c85-ab70-6d9571a8d345', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:12.665221 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:12.744329 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4f9c0fd0-8724-4f21-9484-0b6e2492a2df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:12.746923 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4f9c0fd0-8724-4f21-9484-0b6e2492a2df admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:12.748052 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-4f9c0fd0-8724-4f21-9484-0b6e2492a2df admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3a6a3657-a36a-48b5-891d-bae201decd83 HTTP/1.1" status: 204 len: 168 time: 0.2161434 Aug 24 03:00:12.756443 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f9c0fd0-8724-4f21-9484-0b6e2492a2df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a6a3657-a36a-48b5-891d-bae201decd83,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:12.942309 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1022b7c2-e212-4c0a-845d-686500aef4ef {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:00:12.950279 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:12.961725 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Transition to ACTIVE for port object 1022b7c2-e212-4c0a-845d-686500aef4ef will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:00:13.081925 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:13.167739 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Pushing event updated for resources: {'Port': ['ID=1022b7c2-e212-4c0a-845d-686500aef4ef,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:13.183423 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Attempting to bind port 1022b7c2-e212-4c0a-845d-686500aef4ef on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:00:13.183698 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Attempting to bind port 1022b7c2-e212-4c0a-845d-686500aef4ef by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': '8153f8c3-eca4-496c-bd4f-59ba0022c639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:00:13.184033 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Attempting to bind port 1022b7c2-e212-4c0a-845d-686500aef4ef on network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:00:13.188505 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Port 1022b7c2-e212-4c0a-845d-686500aef4ef on network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:00:13.189095 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Attempting to bind port 1022b7c2-e212-4c0a-845d-686500aef4ef on network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:00:13.201307 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 0, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:00:13.201307 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Checking segment: {'id': '8153f8c3-eca4-496c-bd4f-59ba0022c639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:00:13.201307 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Bound using segment: {'id': '8153f8c3-eca4-496c-bd4f-59ba0022c639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:00:13.201307 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Bound port: 1022b7c2-e212-4c0a-845d-686500aef4ef, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8153f8c3-eca4-496c-bd4f-59ba0022c639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:00:13.201307 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:13.295664 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] For port 1022b7c2-e212-4c0a-845d-686500aef4ef, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:00:13.306365 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] For port 1022b7c2-e212-4c0a-845d-686500aef4ef, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=1022b7c2-e212-4c0a-845d-686500aef4ef,segment=NetworkSegment(8153f8c3-eca4-496c-bd4f-59ba0022c639),segment_id=8153f8c3-eca4-496c-bd4f-59ba0022c639)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:00:13.323775 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7833e0e-aa4c-4d30-ae5d-e6299dd5432f req-b6fb25cc-dc72-4f97-8d48-5865a2b2980c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:13.325655 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b7833e0e-aa4c-4d30-ae5d-e6299dd5432f req-b6fb25cc-dc72-4f97-8d48-5865a2b2980c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0771732 Aug 24 03:00:13.383147 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b7833e0e-aa4c-4d30-ae5d-e6299dd5432f req-1465480a-09a0-437b-ad02-b32a14cd637b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384412 Aug 24 03:00:13.388868 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ae0248-fd0a-4c1b-8a30-aedd9e29c523 req-f5589a86-d27e-4f1b-8662-a93fd5a944c1 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:13.390416 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a5ae0248-fd0a-4c1b-8a30-aedd9e29c523 req-f5589a86-d27e-4f1b-8662-a93fd5a944c1 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 943 time: 0.0539780 Aug 24 03:00:13.435006 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a5ae0248-fd0a-4c1b-8a30-aedd9e29c523 req-10584ffc-1be9-4af7-948a-4d4033349c58 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368896 Aug 24 03:00:13.436511 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:13.455644 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:13.456302 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:13.458024 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] 10.222.0.43 "PUT /v2.0/ports/1022b7c2-e212-4c0a-845d-686500aef4ef HTTP/1.1" status: 200 len: 1093 time: 0.8524930 Aug 24 03:00:13.478023 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0289ba5c-5475-4c85-ab70-6d9571a8d345', 'tag': '1022b7c2-e212-4c0a-845d-686500aef4ef'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:00:13.480691 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c901624-b1b2-4e64-9af2-6839b045a3f8" -d '{"events": [{"name": "network-changed", "server_uuid": "0289ba5c-5475-4c85-ab70-6d9571a8d345", "tag": "1022b7c2-e212-4c0a-845d-686500aef4ef"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:00:13.512598 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b87c877-6458-4a6b-95e3-ae3a31a15dbc service neutron] Pushing event updated for resources: {'Port': ['ID=1022b7c2-e212-4c0a-845d-686500aef4ef,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:13.524351 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:00:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cee96ff3-78ed-49a2-a21a-19c90da61ec9 x-openstack-request-id: req-cee96ff3-78ed-49a2-a21a-19c90da61ec9 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:00:13.524765 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0289ba5c-5475-4c85-ab70-6d9571a8d345", "tag": "1022b7c2-e212-4c0a-845d-686500aef4ef", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:00:13.525118 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cee96ff3-78ed-49a2-a21a-19c90da61ec9 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:00:13.525673 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0289ba5c-5475-4c85-ab70-6d9571a8d345', 'tag': '1022b7c2-e212-4c0a-845d-686500aef4ef', 'status': 'completed', 'code': 200} Aug 24 03:00:13.596187 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c901624-b1b2-4e64-9af2-6839b045a3f8 req-94be1e99-cae3-43dd-8de3-41f1281d3f53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:13.598690 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2c901624-b1b2-4e64-9af2-6839b045a3f8 req-94be1e99-cae3-43dd-8de3-41f1281d3f53 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=3b289da7de434e9ca4c67edc2769c6ab&device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 1096 time: 0.0532041 Aug 24 03:00:13.715484 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c901624-b1b2-4e64-9af2-6839b045a3f8 req-c96689c1-cbb6-4e1f-8a24-c5b7f84b018f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:13.717896 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2c901624-b1b2-4e64-9af2-6839b045a3f8 req-c96689c1-cbb6-4e1f-8a24-c5b7f84b018f service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=3b289da7de434e9ca4c67edc2769c6ab&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1105120 Aug 24 03:00:13.844015 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c901624-b1b2-4e64-9af2-6839b045a3f8 req-52105981-9f31-468e-98bf-da26e46f098b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:13.846388 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2c901624-b1b2-4e64-9af2-6839b045a3f8 req-52105981-9f31-468e-98bf-da26e46f098b service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1109400 Aug 24 03:00:13.965272 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-34392692-f8e3-4bb4-9705-92d79a9e41c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:13.967357 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-34392692-f8e3-4bb4-9705-92d79a9e41c7 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=3b289da7de434e9ca4c67edc2769c6ab&device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 1096 time: 0.0563486 Aug 24 03:00:14.020237 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-39254711-588f-47dd-acd8-6060757cd43d service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=1022b7c2-e212-4c0a-845d-686500aef4ef HTTP/1.1" status: 200 len: 217 time: 0.0442684 Aug 24 03:00:14.086142 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-09d36a67-a84b-4d9d-be52-0dd7bb195cde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:14.087858 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-09d36a67-a84b-4d9d-be52-0dd7bb195cde service neutron] 10.222.0.43 "GET /v2.0/subnets?id=fbe73e0e-d251-4e49-99f9-e952356c2e56 HTTP/1.1" status: 200 len: 854 time: 0.0472772 Aug 24 03:00:14.139752 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-961de9e8-2357-460d-a66e-960b95bd690d service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0373776 Aug 24 03:00:14.236349 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-5c8ae4f5-a08a-4ed4-88b4-e95b6cde3e5c service neutron] 10.222.0.43 "GET /v2.0/networks/f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891848 Aug 24 03:00:14.342113 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0cefab1a-d7b9-48c3-991a-a7c2ef6e3e53 req-0ca78261-a6fd-4df2-9341-9477ca19d57d service neutron] 10.222.0.43 "GET /v2.0/networks/f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0940509 Aug 24 03:00:14.505494 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751b0dea-1858-4d37-b106-b6c7c13e8125 req-e9fbfb36-e5ed-4d98-8a9c-9f233e8d9fb3 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:14.507199 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-751b0dea-1858-4d37-b106-b6c7c13e8125 req-e9fbfb36-e5ed-4d98-8a9c-9f233e8d9fb3 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0576959 Aug 24 03:00:14.549210 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-751b0dea-1858-4d37-b106-b6c7c13e8125 req-388553dd-eb17-4640-b03f-c6593a4fe01e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0350330 Aug 24 03:00:14.571268 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66dbd7e5-0aec-431e-a6e7-409224f2267e req-15675474-0cf9-4166-97d2-3a4990f69802 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:14.574807 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-66dbd7e5-0aec-431e-a6e7-409224f2267e req-15675474-0cf9-4166-97d2-3a4990f69802 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 943 time: 0.0629930 Aug 24 03:00:14.654336 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-66dbd7e5-0aec-431e-a6e7-409224f2267e req-3c67e76a-81f2-433d-b802-bc7695c577ea tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705123 Aug 24 03:00:15.638371 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60646) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:15.674699 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5a72f8d-8b71-4722-ac41-b4acb318acfd req-8ce77b5b-0d88-46dd-9704-b17a23809384 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:15.676492 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a5a72f8d-8b71-4722-ac41-b4acb318acfd req-8ce77b5b-0d88-46dd-9704-b17a23809384 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0549619 Aug 24 03:00:15.726754 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a5a72f8d-8b71-4722-ac41-b4acb318acfd req-6571ea62-f87c-40b5-a2a5-62cff4cd1b07 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395961 Aug 24 03:00:15.776303 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0deb71f9-6607-4199-8e75-7905d763a83a admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:15.814072 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b335d1f-a21d-41ce-922f-16ac65f615bb req-8081c1fa-2f62-4438-9a6a-ed4ab8b0d769 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:15.815510 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7b335d1f-a21d-41ce-922f-16ac65f615bb req-8081c1fa-2f62-4438-9a6a-ed4ab8b0d769 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 943 time: 0.0774853 Aug 24 03:00:15.876184 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7b335d1f-a21d-41ce-922f-16ac65f615bb req-e36cca6e-c4ff-423a-8efb-e34793f30111 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533962 Aug 24 03:00:15.918562 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0deb71f9-6607-4199-8e75-7905d763a83a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:16.064726 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0deb71f9-6607-4199-8e75-7905d763a83a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:16.106329 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-0deb71f9-6607-4199-8e75-7905d763a83a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=0c8b2e3304954f2484161ee1d4cd0fc6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4663248 Aug 24 03:00:16.107515 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0deb71f9-6607-4199-8e75-7905d763a83a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d6e7c01e-c061-47ec-beed-aa152adf6c60,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:16.109127 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 60664) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:16.165423 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-92d531c4-7c31-4d19-82d4-1b48b73dc8e7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:16.185635 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-92d531c4-7c31-4d19-82d4-1b48b73dc8e7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:16.361565 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-92d531c4-7c31-4d19-82d4-1b48b73dc8e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:16.364082 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-92d531c4-7c31-4d19-82d4-1b48b73dc8e7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:16.365229 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-92d531c4-7c31-4d19-82d4-1b48b73dc8e7 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d6e7c01e-c061-47ec-beed-aa152adf6c60 HTTP/1.1" status: 204 len: 168 time: 0.2531114 Aug 24 03:00:16.372670 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d531c4-7c31-4d19-82d4-1b48b73dc8e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d6e7c01e-c061-47ec-beed-aa152adf6c60,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:16.646477 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 1022b7c2-e212-4c0a-845d-686500aef4ef details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:00:16.740042 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 1022b7c2-e212-4c0a-845d-686500aef4ef, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=1022b7c2-e212-4c0a-845d-686500aef4ef,segment=NetworkSegment(8153f8c3-eca4-496c-bd4f-59ba0022c639),segment_id=8153f8c3-eca4-496c-bd4f-59ba0022c639)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:16.751020 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '1022b7c2-e212-4c0a-845d-686500aef4ef', 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee', 'port_id': '1022b7c2-e212-4c0a-845d-686500aef4ef', 'mac_address': 'fa:16:3e:61:92:de', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 361, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fbe73e0e-d251-4e49-99f9-e952356c2e56', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:00:16.791395 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:16.807576 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1022b7c2-e212-4c0a-845d-686500aef4ef {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:00:16.836471 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 1022b7c2-e212-4c0a-845d-686500aef4ef, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=1022b7c2-e212-4c0a-845d-686500aef4ef,segment=NetworkSegment(8153f8c3-eca4-496c-bd4f-59ba0022c639),segment_id=8153f8c3-eca4-496c-bd4f-59ba0022c639)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:16.860797 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4ec7724-a50c-43ca-b15b-74e4ac214fb3 req-6bc0b481-5b2a-40bf-a195-214ce0b09881 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:16.862412 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d4ec7724-a50c-43ca-b15b-74e4ac214fb3 req-6bc0b481-5b2a-40bf-a195-214ce0b09881 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0555570 Aug 24 03:00:16.907428 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d4ec7724-a50c-43ca-b15b-74e4ac214fb3 req-b4c8e625-2a1c-4f98-9818-9e4a958c46c7 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0343034 Aug 24 03:00:16.931458 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:17.001922 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=1022b7c2-e212-4c0a-845d-686500aef4ef,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:17.030687 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c04fa63c-d66f-417d-bf05-5db051beb03f req-de9ad760-c865-485f-80e1-fddabcea1b30 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:17.032129 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c04fa63c-d66f-417d-bf05-5db051beb03f req-de9ad760-c865-485f-80e1-fddabcea1b30 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 944 time: 0.0679479 Aug 24 03:00:17.071645 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c04fa63c-d66f-417d-bf05-5db051beb03f req-29ba6d0e-2de9-4f08-942f-20779c07aa58 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334358 Aug 24 03:00:17.294375 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['1022b7c2-e212-4c0a-845d-686500aef4ef'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:00:17.309962 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 60698) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:17.325700 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b9006f10-49f3-4060-95cd-c3f767ae6d4c admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:17.423060 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b9006f10-49f3-4060-95cd-c3f767ae6d4c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:17.543774 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b9006f10-49f3-4060-95cd-c3f767ae6d4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:17.585628 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-b9006f10-49f3-4060-95cd-c3f767ae6d4c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=22dddb95d7e84248880db7ad64043024&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2720950 Aug 24 03:00:17.585628 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9006f10-49f3-4060-95cd-c3f767ae6d4c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b272f95-c0c5-4905-95d0-ba7bca184587,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:17.586186 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60706) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:17.639799 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-18f3c304-b1dc-4559-9c1f-070cc0fb9a2a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:17.660414 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-18f3c304-b1dc-4559-9c1f-070cc0fb9a2a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:17.858295 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-18f3c304-b1dc-4559-9c1f-070cc0fb9a2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:17.860843 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-18f3c304-b1dc-4559-9c1f-070cc0fb9a2a admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:17.862066 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-18f3c304-b1dc-4559-9c1f-070cc0fb9a2a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/9b272f95-c0c5-4905-95d0-ba7bca184587 HTTP/1.1" status: 204 len: 168 time: 0.2750423 Aug 24 03:00:17.870717 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f3c304-b1dc-4559-9c1f-070cc0fb9a2a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b272f95-c0c5-4905-95d0-ba7bca184587,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:18.051569 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac231b03-b475-432c-89f8-3376fe74e8cc req-a8717b09-8008-407c-98cb-d112bc669aed tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:18.053035 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ac231b03-b475-432c-89f8-3376fe74e8cc req-a8717b09-8008-407c-98cb-d112bc669aed tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0504344 Aug 24 03:00:18.091258 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ac231b03-b475-432c-89f8-3376fe74e8cc req-25759d6e-c9be-49cf-8525-7857a7fa7ac7 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314939 Aug 24 03:00:18.202113 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf15f12-f96c-41c0-8b4f-f8725bc88cf5 req-5cb0bb83-3db3-4029-a164-f50b3c55fade tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:18.203573 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4bf15f12-f96c-41c0-8b4f-f8725bc88cf5 req-5cb0bb83-3db3-4029-a164-f50b3c55fade tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 944 time: 0.0525196 Aug 24 03:00:18.246624 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4bf15f12-f96c-41c0-8b4f-f8725bc88cf5 req-c5965d87-1b6b-402b-b483-c5b2e6e51116 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0365248 Aug 24 03:00:18.946993 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60752) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:18.959870 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-607f768e-4b45-4886-b02c-fb5d037cf241 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:19.026116 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63386098-762a-4894-8cfa-dae6e4171c49 req-13f36304-ea5e-4e92-803f-e872a3a921f8 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:19.027633 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-63386098-762a-4894-8cfa-dae6e4171c49 req-13f36304-ea5e-4e92-803f-e872a3a921f8 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.0498962 Aug 24 03:00:19.052394 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-607f768e-4b45-4886-b02c-fb5d037cf241 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:19.065703 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-63386098-762a-4894-8cfa-dae6e4171c49 req-82511b39-dd27-4232-8429-2b732bf426b6 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320220 Aug 24 03:00:19.172354 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-607f768e-4b45-4886-b02c-fb5d037cf241 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:19.177620 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 1022b7c2-e212-4c0a-845d-686500aef4ef up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:00:19.213911 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13f0e98f-adb0-4df9-9233-6059fd71cf29 req-087fc037-9658-4bd1-af59-7717e3215596 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:19.215567 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-13f0e98f-adb0-4df9-9233-6059fd71cf29 req-087fc037-9658-4bd1-af59-7717e3215596 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0558221 Aug 24 03:00:19.217327 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-607f768e-4b45-4886-b02c-fb5d037cf241 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=22bdc708206041c9b7d779f58be5dc0f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2692771 Aug 24 03:00:19.219456 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607f768e-4b45-4886-b02c-fb5d037cf241 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c076e782-4b94-4701-8ca7-f21d84d2f329,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:19.220063 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 60760) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:19.288072 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-13f0e98f-adb0-4df9-9233-6059fd71cf29 req-3c6d51d4-6737-4358-b6a7-f0f42d9f883b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601790 Aug 24 03:00:19.300774 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4064732f-d6dc-4a8c-83d2-e9c9e7e0b499 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:19.324715 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4064732f-d6dc-4a8c-83d2-e9c9e7e0b499 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:19.388779 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 1022b7c2-e212-4c0a-845d-686500aef4ef completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:00:19.393436 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 1022b7c2-e212-4c0a-845d-686500aef4ef triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:19.393840 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:19.401531 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e178568-cdf5-401c-a394-f87fd20e4eb0 req-14ee127f-3bb3-4939-9322-ee4cf4870108 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:19.403028 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4e178568-cdf5-401c-a394-f87fd20e4eb0 req-14ee127f-3bb3-4939-9322-ee4cf4870108 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 944 time: 0.0558128 Aug 24 03:00:19.441233 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4e178568-cdf5-401c-a394-f87fd20e4eb0 req-d8625f1c-402a-4245-b49a-11cb8ba359da tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322733 Aug 24 03:00:19.471570 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:19.493251 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4064732f-d6dc-4a8c-83d2-e9c9e7e0b499 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:19.493822 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0289ba5c-5475-4c85-ab70-6d9571a8d345', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1022b7c2-e212-4c0a-845d-686500aef4ef'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:00:19.495984 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4064732f-d6dc-4a8c-83d2-e9c9e7e0b499 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:19.496094 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1590273c-f35c-412d-b819-d316db8c7112" -d '{"events": [{"server_uuid": "0289ba5c-5475-4c85-ab70-6d9571a8d345", "name": "network-vif-plugged", "status": "completed", "tag": "1022b7c2-e212-4c0a-845d-686500aef4ef"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:00:19.497115 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-4064732f-d6dc-4a8c-83d2-e9c9e7e0b499 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c076e782-4b94-4701-8ca7-f21d84d2f329 HTTP/1.1" status: 204 len: 168 time: 0.2759840 Aug 24 03:00:19.509472 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 1022b7c2-e212-4c0a-845d-686500aef4ef, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=1022b7c2-e212-4c0a-845d-686500aef4ef,segment=NetworkSegment(8153f8c3-eca4-496c-bd4f-59ba0022c639),segment_id=8153f8c3-eca4-496c-bd4f-59ba0022c639)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:19.515702 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4064732f-d6dc-4a8c-83d2-e9c9e7e0b499 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c076e782-4b94-4701-8ca7-f21d84d2f329,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:19.542115 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:00:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81536ba3-d1c6-47cd-bf5b-3cdc715ac32b x-openstack-request-id: req-81536ba3-d1c6-47cd-bf5b-3cdc715ac32b {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:00:19.542433 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0289ba5c-5475-4c85-ab70-6d9571a8d345", "name": "network-vif-plugged", "status": "completed", "tag": "1022b7c2-e212-4c0a-845d-686500aef4ef", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:00:19.542693 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-81536ba3-d1c6-47cd-bf5b-3cdc715ac32b {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:00:19.543076 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0289ba5c-5475-4c85-ab70-6d9571a8d345', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1022b7c2-e212-4c0a-845d-686500aef4ef', 'code': 200} Aug 24 03:00:19.577147 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:00:19.612000 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:19.658543 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=1022b7c2-e212-4c0a-845d-686500aef4ef,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:20.187408 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6840215f-9a62-49fd-88d0-06ae3c72ce41 req-da5bbfa9-a2f0-485a-8ecf-effde6a689f7 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:20.189134 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6840215f-9a62-49fd-88d0-06ae3c72ce41 req-da5bbfa9-a2f0-485a-8ecf-effde6a689f7 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.0487914 Aug 24 03:00:20.231559 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6840215f-9a62-49fd-88d0-06ae3c72ce41 req-3efc75d2-2e0b-426a-9721-d9e935b64e00 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354323 Aug 24 03:00:20.405857 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-181aca1b-fd8e-4db1-ab33-013fc7c0e83e req-76c44159-d9b2-4897-98e0-e07dabec3d3a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:20.407333 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-181aca1b-fd8e-4db1-ab33-013fc7c0e83e req-76c44159-d9b2-4897-98e0-e07dabec3d3a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0508261 Aug 24 03:00:20.447841 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-181aca1b-fd8e-4db1-ab33-013fc7c0e83e req-7d645b7b-c094-4bd6-914f-d0dd1b18be46 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0343890 Aug 24 03:00:20.551280 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4727458-4601-4fc0-a919-10404f59abd3 req-e66ae4ea-f3b5-403b-8e78-20651ee5fb69 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:20.553012 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a4727458-4601-4fc0-a919-10404f59abd3 req-e66ae4ea-f3b5-403b-8e78-20651ee5fb69 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 945 time: 0.0482597 Aug 24 03:00:20.595599 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a4727458-4601-4fc0-a919-10404f59abd3 req-b0489325-b5e6-47ee-8b2d-06af1116c073 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355127 Aug 24 03:00:21.356764 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9e5e8c-09bf-4bd9-9986-9b0115eb9723 req-cca0e6c3-d97a-4c0d-a0d6-efe0651ba79a tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:21.359836 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0a9e5e8c-09bf-4bd9-9986-9b0115eb9723 req-cca0e6c3-d97a-4c0d-a0d6-efe0651ba79a tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.0617440 Aug 24 03:00:21.407309 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0a9e5e8c-09bf-4bd9-9986-9b0115eb9723 req-1e684f6a-928e-46fb-91ca-3986469a14e3 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361247 Aug 24 03:00:21.464030 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-db122bc1-61e6-49b5-abb6-f0e457575d2b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:21.568111 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aeb7c47-7934-4baa-976c-1060d956c002 req-63f4860b-f412-4916-be07-1521e070b77a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:21.576319 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3aeb7c47-7934-4baa-976c-1060d956c002 req-63f4860b-f412-4916-be07-1521e070b77a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0586593 Aug 24 03:00:21.612363 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3aeb7c47-7934-4baa-976c-1060d956c002 req-c887e1ff-5d09-4ab7-bbce-72e4f156f986 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0350823 Aug 24 03:00:21.672777 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 60828) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:21.733294 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe614b38-c7ec-4c4b-b966-f6eb6505a529 req-6eba4dcf-aa13-41ee-880c-af3e5411eaae tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:21.734818 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fe614b38-c7ec-4c4b-b966-f6eb6505a529 req-6eba4dcf-aa13-41ee-880c-af3e5411eaae tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 945 time: 0.0497873 Aug 24 03:00:21.786440 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fe614b38-c7ec-4c4b-b966-f6eb6505a529 req-0e150198-e3e4-4f74-a306-2788cd388d2e tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456848 Aug 24 03:00:21.787276 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-851bd100-adf8-4e80-8df9-e586f19b029b admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:21.873855 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-851bd100-adf8-4e80-8df9-e586f19b029b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:21.948136 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-851bd100-adf8-4e80-8df9-e586f19b029b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:21.985911 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-851bd100-adf8-4e80-8df9-e586f19b029b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6a88585e56a94064a966f10c1c0cf6ac&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3119631 Aug 24 03:00:21.987019 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-851bd100-adf8-4e80-8df9-e586f19b029b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b39a4203-67bf-4c95-98f2-58bb852312e3,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:21.988736 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60834) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:22.039669 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7bf010db-7f1c-4430-b2ed-23d230e410fb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:22.060027 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7bf010db-7f1c-4430-b2ed-23d230e410fb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:22.229251 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7bf010db-7f1c-4430-b2ed-23d230e410fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:22.231966 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7bf010db-7f1c-4430-b2ed-23d230e410fb admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:22.233118 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-7bf010db-7f1c-4430-b2ed-23d230e410fb admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b39a4203-67bf-4c95-98f2-58bb852312e3 HTTP/1.1" status: 204 len: 168 time: 0.2432518 Aug 24 03:00:22.240719 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf010db-7f1c-4430-b2ed-23d230e410fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b39a4203-67bf-4c95-98f2-58bb852312e3,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:22.525756 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-032ff53f-d826-4f11-92d5-ae988478c3a0 req-c3fb4201-9298-4881-8811-752749a2d149 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:22.527207 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-032ff53f-d826-4f11-92d5-ae988478c3a0 req-c3fb4201-9298-4881-8811-752749a2d149 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.0526342 Aug 24 03:00:22.566990 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-032ff53f-d826-4f11-92d5-ae988478c3a0 req-2cdd5187-f93a-4fa1-95e8-2a3c1b20a075 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0337594 Aug 24 03:00:22.731637 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31d2eb33-764b-4257-90bc-38f23b00de85 req-5cbec3cd-37fb-450b-b14d-4e0d0b45c7f8 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:22.733089 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-31d2eb33-764b-4257-90bc-38f23b00de85 req-5cbec3cd-37fb-450b-b14d-4e0d0b45c7f8 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0479467 Aug 24 03:00:22.770270 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-31d2eb33-764b-4257-90bc-38f23b00de85 req-f5ec525f-468a-4bd3-8977-33fe515d1e98 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312200 Aug 24 03:00:22.899102 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcb76254-ba6d-4e39-8761-fc9255748cee req-428abbf2-75f8-4f34-a22c-03207f1d2956 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:22.900575 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fcb76254-ba6d-4e39-8761-fc9255748cee req-428abbf2-75f8-4f34-a22c-03207f1d2956 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 945 time: 0.0478411 Aug 24 03:00:22.931968 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 60852) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:22.949314 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fcb76254-ba6d-4e39-8761-fc9255748cee req-05d13060-e53f-4854-8da7-5868ae1b4460 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426404 Aug 24 03:00:22.950406 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-5db61535-70a1-41a1-b05a-c31f576eba92 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:23.043605 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-5db61535-70a1-41a1-b05a-c31f576eba92 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:23.143707 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-5db61535-70a1-41a1-b05a-c31f576eba92 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:23.180725 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-5db61535-70a1-41a1-b05a-c31f576eba92 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=4079de3d5822426f8be17b258bef4fa4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2477815 Aug 24 03:00:23.181538 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5db61535-70a1-41a1-b05a-c31f576eba92 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b63052ed-0fb7-4f64-b462-5af661525595,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:23.183474 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 60858) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:23.231095 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0efa4958-585a-49d4-b7df-171e865a9aa4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:23.253584 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0efa4958-585a-49d4-b7df-171e865a9aa4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:23.441335 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0efa4958-585a-49d4-b7df-171e865a9aa4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:23.444005 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0efa4958-585a-49d4-b7df-171e865a9aa4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:23.446176 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-0efa4958-585a-49d4-b7df-171e865a9aa4 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b63052ed-0fb7-4f64-b462-5af661525595 HTTP/1.1" status: 204 len: 168 time: 0.2616527 Aug 24 03:00:23.455659 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0efa4958-585a-49d4-b7df-171e865a9aa4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b63052ed-0fb7-4f64-b462-5af661525595,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:23.680426 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca0e72b7-83be-4535-8559-a1eb0bb27833 req-ff6890bd-464d-4372-9dd2-6e5b11308750 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:23.681964 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ca0e72b7-83be-4535-8559-a1eb0bb27833 req-ff6890bd-464d-4372-9dd2-6e5b11308750 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.0481672 Aug 24 03:00:23.720711 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ca0e72b7-83be-4535-8559-a1eb0bb27833 req-92c24e7c-2e01-45d2-b117-c37feb09a051 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328615 Aug 24 03:00:23.885848 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2baf4436-2611-4ce9-acf1-fd4211e962da req-f6e8ba83-ee0c-4bba-9d51-7c726c5467ea tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:23.887375 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2baf4436-2611-4ce9-acf1-fd4211e962da req-f6e8ba83-ee0c-4bba-9d51-7c726c5467ea tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0498972 Aug 24 03:00:23.927885 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2baf4436-2611-4ce9-acf1-fd4211e962da req-931ccb51-85f7-425a-9043-77d1277a689b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315859 Aug 24 03:00:23.960821 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-72cf8d09-0598-496d-89d3-2548548148ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:24.069055 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d320154-d9aa-4f3c-9f6f-b7f416d4f326 req-944b66c9-b526-41db-ad8b-317cf3206fe3 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:24.070810 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7d320154-d9aa-4f3c-9f6f-b7f416d4f326 req-944b66c9-b526-41db-ad8b-317cf3206fe3 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 945 time: 0.0528228 Aug 24 03:00:24.109558 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7d320154-d9aa-4f3c-9f6f-b7f416d4f326 req-b89993c7-6f08-41bc-8136-5f3b1c4aa378 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323772 Aug 24 03:00:24.310904 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec43da37-4c70-4523-a5af-8e22ced6f70b req-5e811ccf-1579-4e6e-ad8b-2fb86c4e3fd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:24.312512 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ec43da37-4c70-4523-a5af-8e22ced6f70b req-5e811ccf-1579-4e6e-ad8b-2fb86c4e3fd0 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 1098 time: 0.0401409 Aug 24 03:00:24.315739 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:24.357038 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ec43da37-4c70-4523-a5af-8e22ced6f70b req-0cd72590-28a1-4c6a-a927-c035ea7f7a18 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0303614 Aug 24 03:00:24.835845 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70733e9c-a677-43f4-bfdd-e1c8cc0a3317 req-861ffb69-a6db-47f5-a331-1cea25df9cab tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:24.837547 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-70733e9c-a677-43f4-bfdd-e1c8cc0a3317 req-861ffb69-a6db-47f5-a331-1cea25df9cab tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.0496199 Aug 24 03:00:24.875312 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-70733e9c-a677-43f4-bfdd-e1c8cc0a3317 req-00d7c4be-7299-46ec-9aa1-5eca114bdc55 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320528 Aug 24 03:00:25.049640 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b66bcc3d-92ab-4357-b815-f1f57c42dc13 req-1e27149c-85e9-4bff-8e7d-e4bdc8575d78 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:25.051140 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b66bcc3d-92ab-4357-b815-f1f57c42dc13 req-1e27149c-85e9-4bff-8e7d-e4bdc8575d78 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0503953 Aug 24 03:00:25.091913 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b66bcc3d-92ab-4357-b815-f1f57c42dc13 req-74373aab-3f57-4adb-9abd-08723ce05d2f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342503 Aug 24 03:00:25.250069 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b45304-7355-41c2-9d29-99d94d76153f req-ec760f3b-e09b-427d-b80e-3c2992c0f18b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:25.251623 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-72b45304-7355-41c2-9d29-99d94d76153f req-ec760f3b-e09b-427d-b80e-3c2992c0f18b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 945 time: 0.0653553 Aug 24 03:00:25.297968 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-72b45304-7355-41c2-9d29-99d94d76153f req-43b3ee3e-e5c3-492e-b8de-e70db38fe137 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388916 Aug 24 03:00:25.555240 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:26.003478 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e87739df-4133-4784-a26d-9098a4a89950 req-0db61d14-3e20-4e86-a11f-c9c45cfb5c38 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:26.004993 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e87739df-4133-4784-a26d-9098a4a89950 req-0db61d14-3e20-4e86-a11f-c9c45cfb5c38 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.0552652 Aug 24 03:00:26.058462 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e87739df-4133-4784-a26d-9098a4a89950 req-4cc742f9-1b8c-4eba-b2c6-f2a158453f20 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456975 Aug 24 03:00:26.129422 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-d7dcf807-3ed9-4a13-baf1-43cce50b2b0b tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/networks?tenant_id=1ac6ae42d3d3478aab4103c3629db149&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0296392 Aug 24 03:00:26.209039 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5446c471-18b8-4d08-be5a-b7e11d1d5fd0 req-f55a1e9f-0d72-4f61-9370-339556a408b7 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:26.211195 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5446c471-18b8-4d08-be5a-b7e11d1d5fd0 req-f55a1e9f-0d72-4f61-9370-339556a408b7 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0510545 Aug 24 03:00:26.249692 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5446c471-18b8-4d08-be5a-b7e11d1d5fd0 req-ff485708-dfbc-4abf-8bd0-b7553892badb tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320985 Aug 24 03:00:26.334173 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11819117-ee35-4a68-b54b-683f8c08a705 req-740d1590-ffc3-4ebe-9347-997b8cf45a70 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:26.336118 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-740d1590-ffc3-4ebe-9347-997b8cf45a70 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1993222 Aug 24 03:00:26.351334 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-0f5b7394-2980-4985-8664-f38df51a510a tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/quotas/1ac6ae42d3d3478aab4103c3629db149 HTTP/1.1" status: 200 len: 375 time: 0.0091457 Aug 24 03:00:26.382731 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-b85de280-bef5-4c35-ac3f-42c2e8865f0e tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=1ac6ae42d3d3478aab4103c3629db149&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0246563 Aug 24 03:00:26.427570 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25ee50aa-9d83-4ca4-b844-95fdf98df382 req-94b901ec-2dd3-40bf-8728-aafd868cfd04 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:26.429901 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-25ee50aa-9d83-4ca4-b844-95fdf98df382 req-94b901ec-2dd3-40bf-8728-aafd868cfd04 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 945 time: 0.0613258 Aug 24 03:00:26.471381 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-25ee50aa-9d83-4ca4-b844-95fdf98df382 req-aa713fa9-4b19-4a4f-b3eb-a365869fddb2 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0353553 Aug 24 03:00:26.557290 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1daef8de-1cf2-4ca1-a18d-c7bf6e95d102 req-9fc78a5b-f0e9-4629-a054-9f3a171c97ce tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:26.559073 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1daef8de-1cf2-4ca1-a18d-c7bf6e95d102 req-9fc78a5b-f0e9-4629-a054-9f3a171c97ce tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.0637658 Aug 24 03:00:26.696593 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-45b88ecd-9911-4556-af34-7b71471f7fee req-bfbd3c50-a462-4c05-b576-0e5820a2eb61 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 210 time: 0.0603185 Aug 24 03:00:26.778823 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-1daef8de-1cf2-4ca1-a18d-c7bf6e95d102 req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Deleting port 39c14867-cd45-4087-ae6b-c6c669cf7402 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:00:26.780768 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-1daef8de-1cf2-4ca1-a18d-c7bf6e95d102 req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:26.879625 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-1daef8de-1cf2-4ca1-a18d-c7bf6e95d102 req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] For port 39c14867-cd45-4087-ae6b-c6c669cf7402, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=39c14867-cd45-4087-ae6b-c6c669cf7402,segment=NetworkSegment(5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6),segment_id=5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:26.879991 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-1daef8de-1cf2-4ca1-a18d-c7bf6e95d102 req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:26.894656 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-1daef8de-1cf2-4ca1-a18d-c7bf6e95d102 req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Calling delete_port for 39c14867-cd45-4087-ae6b-c6c669cf7402 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:00:27.024125 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:27.174989 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c84fe8-82c6-4c6b-a1e4-92e38c6ccfc8 req-c978afb8-20a6-465c-88d6-90abe9090163 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:27.176478 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c7c84fe8-82c6-4c6b-a1e4-92e38c6ccfc8 req-c978afb8-20a6-465c-88d6-90abe9090163 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 946 time: 0.0476167 Aug 24 03:00:27.215772 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c7c84fe8-82c6-4c6b-a1e4-92e38c6ccfc8 req-3132a09a-62a3-4c48-83f3-a37a43106dc9 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/security-groups?id=4c193609-dcd3-47f2-8d2d-5b04db402f74&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322013 Aug 24 03:00:27.247287 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-1daef8de-1cf2-4ca1-a18d-c7bf6e95d102 req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:27.260195 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['39c14867-cd45-4087-ae6b-c6c669cf7402'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:00:27.278636 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Pushing event deleted for resources: {'Port': ['ID=39c14867-cd45-4087-ae6b-c6c669cf7402,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:27.310356 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:27.310731 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:27.311079 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:27.311419 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:27.311750 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:27.312077 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:27.312452 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:27.312784 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:27.313368 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:27.313797 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:27.314148 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:27.319686 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:27.352140 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-1daef8de-1cf2-4ca1-a18d-c7bf6e95d102 req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] No DVR routers for this DVR port 39c14867-cd45-4087-ae6b-c6c669cf7402 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:00:27.355403 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-1daef8de-1cf2-4ca1-a18d-c7bf6e95d102 req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:27.358317 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1daef8de-1cf2-4ca1-a18d-c7bf6e95d102 req-cf934d99-87ae-4e57-ae5c-be414bb8ff0f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.43 "DELETE /v2.0/ports/39c14867-cd45-4087-ae6b-c6c669cf7402 HTTP/1.1" status: 204 len: 173 time: 0.7911732 Aug 24 03:00:27.358744 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae754fd3-e7a1-4454-806c-894608de1aaf', 'name': 'network-vif-deleted', 'tag': '39c14867-cd45-4087-ae6b-c6c669cf7402'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:00:27.360998 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-67b9a986-4f72-4b5c-b028-a15702020b7e" -d '{"events": [{"server_uuid": "ae754fd3-e7a1-4454-806c-894608de1aaf", "name": "network-vif-deleted", "tag": "39c14867-cd45-4087-ae6b-c6c669cf7402"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:00:27.390928 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f057a068-88d2-411b-a07d-a410a2af1946 req-4c661b8c-fb9a-45a0-bdcc-169c052e55bf tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:27.390928 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f057a068-88d2-411b-a07d-a410a2af1946 req-4c661b8c-fb9a-45a0-bdcc-169c052e55bf tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0617499 Aug 24 03:00:27.404483 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:00:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-10d90942-a11b-43be-bbac-9d9711c24a70 x-openstack-request-id: req-10d90942-a11b-43be-bbac-9d9711c24a70 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:00:27.404780 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae754fd3-e7a1-4454-806c-894608de1aaf", "name": "network-vif-deleted", "tag": "39c14867-cd45-4087-ae6b-c6c669cf7402", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:00:27.405037 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-10d90942-a11b-43be-bbac-9d9711c24a70 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:00:27.405434 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae754fd3-e7a1-4454-806c-894608de1aaf', 'name': 'network-vif-deleted', 'tag': '39c14867-cd45-4087-ae6b-c6c669cf7402', 'status': 'completed', 'code': 200} Aug 24 03:00:27.430325 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f057a068-88d2-411b-a07d-a410a2af1946 req-ad3113d8-6e19-4a97-82aa-1f8cdb22c6aa tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0353696 Aug 24 03:00:27.790343 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b0158f2a-6186-4c80-89a9-8f274f08df94 req-c13818bb-d342-4c7a-8cc5-68f5a8398e06 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 210 time: 0.0301247 Aug 24 03:00:28.314620 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2dcdc234-10bb-41cf-9948-68e8e603bc21 req-13a42182-10f7-4b1a-9b05-3da2685cc9dc tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 210 time: 0.0265915 Aug 24 03:00:28.697325 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e522d02-097d-4c65-9f22-9354cc8655ca req-123b4c0d-06bc-482c-bd0e-65cac0e5ae78 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:28.697325 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6e522d02-097d-4c65-9f22-9354cc8655ca req-123b4c0d-06bc-482c-bd0e-65cac0e5ae78 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0484128 Aug 24 03:00:28.697325 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6e522d02-097d-4c65-9f22-9354cc8655ca req-07b647ca-1957-4b28-afab-5945553d88b7 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319831 Aug 24 03:00:28.898947 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a6b55266-89b4-48f9-bc63-053353912f40 req-ca4df879-a623-40e7-ba8d-0b8d8a516aa3 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 210 time: 0.0264525 Aug 24 03:00:29.427941 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1a5e4369-2d46-4809-8d64-553950891e0d req-714a4771-7526-4745-87bc-1cdaf5fcdf7f tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 210 time: 0.0244260 Aug 24 03:00:29.789683 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07614651-50b7-49c7-b095-1b5639f30b34 req-25b2743f-7bc5-476a-adea-d6e5982da67e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:29.791142 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-07614651-50b7-49c7-b095-1b5639f30b34 req-25b2743f-7bc5-476a-adea-d6e5982da67e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0467818 Aug 24 03:00:29.828644 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-07614651-50b7-49c7-b095-1b5639f30b34 req-8e79fd95-d844-491f-8cb5-b9b9da53ba07 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315485 Aug 24 03:00:29.999145 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4b36a2dc-8f49-452f-87d1-3f1014c894ed req-42d0189b-8ec6-4e90-8584-8e8d42d59457 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 210 time: 0.0281522 Aug 24 03:00:30.534003 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6f3b7ecb-1399-4fa3-8fc2-9c46196a49f1 req-54e2ed13-77ac-4f1d-953b-dc8fdbe798e1 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 210 time: 0.0243402 Aug 24 03:00:30.940854 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca70293-c8a4-4178-90e7-1a17fac5d03f req-d50dbef3-132f-4a07-9040-9dd47b3add00 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:30.942497 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1ca70293-c8a4-4178-90e7-1a17fac5d03f req-d50dbef3-132f-4a07-9040-9dd47b3add00 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0477011 Aug 24 03:00:30.980971 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1ca70293-c8a4-4178-90e7-1a17fac5d03f req-a8ab3da2-ca99-43fa-8f7f-4c757c6d01ba tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314341 Aug 24 03:00:31.087848 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5c4b3b37-a40d-41ae-bec3-0862445af9ec req-9c009280-c4d4-440a-9c5c-f2e7d2c0078c tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 210 time: 0.0254247 Aug 24 03:00:31.137391 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 39c14867-cd45-4087-ae6b-c6c669cf7402 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:00:31.156934 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 39c14867-cd45-4087-ae6b-c6c669cf7402 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:00:31.157271 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 39c14867-cd45-4087-ae6b-c6c669cf7402 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:00:31.637942 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7bc01c63-3311-4dd5-b08d-cc8e2819e985 req-8e3acab1-1c00-4a39-9c76-b8c70f64cd37 tempest-DeleteServersTestJSON-929913961 tempest-DeleteServersTestJSON-929913961-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae754fd3-e7a1-4454-806c-894608de1aaf HTTP/1.1" status: 200 len: 210 time: 0.0276587 Aug 24 03:00:32.095174 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67eb6d12-9188-43d5-ba91-7442a584064d req-c0ad6d69-27cf-45f4-bcae-d30a00d3e5b2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:32.097216 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-67eb6d12-9188-43d5-ba91-7442a584064d req-c0ad6d69-27cf-45f4-bcae-d30a00d3e5b2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0484104 Aug 24 03:00:32.132825 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-67eb6d12-9188-43d5-ba91-7442a584064d req-ae9e4428-9bf8-4dee-8798-3ab465648d91 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0301433 Aug 24 03:00:32.212205 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2bd85f64-b40f-4711-a93c-2d51f1bda111 req-2db638f8-b482-4449-aa06-295e4da8638f tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 210 time: 0.0267346 Aug 24 03:00:33.020769 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-00428385-bf6f-46ab-ae6d-b6e66fbed6c7 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.43 "GET /v2.0/networks?tenant_id=1ac6ae42d3d3478aab4103c3629db149&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0275033 Aug 24 03:00:33.288093 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11819117-ee35-4a68-b54b-683f8c08a705 req-7b061994-60d6-43bc-b41f-5927ce918ad5 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:33.289762 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-7b061994-60d6-43bc-b41f-5927ce918ad5 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2607732 Aug 24 03:00:33.310887 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2015077c-3ea4-4181-87ca-a802e46c9632 req-5f0b9668-dd48-4b13-b667-f3bad54f3e82 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:33.312479 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2015077c-3ea4-4181-87ca-a802e46c9632 req-5f0b9668-dd48-4b13-b667-f3bad54f3e82 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0744233 Aug 24 03:00:33.316417 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Request body: {'port': {'device_id': 'd5af1509-b98e-44c3-b607-1518e6fa8577', 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de', 'admin_state_up': True, 'tenant_id': '1ac6ae42d3d3478aab4103c3629db149'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:33.482171 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7e2cdd7d-538d-4e88-939c-dd99fa9fa100 req-a87b34f9-498f-4815-b529-dc26ea3591ab tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 210 time: 0.0313218 Aug 24 03:00:33.511060 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 32984) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:33.566002 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Deleting subnet 08baa807-6f5d-4e59-891a-d1a97caf8fe9 {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:00:33.570588 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:33.607260 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:33.617725 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:33.689004 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2015077c-3ea4-4181-87ca-a802e46c9632 req-7e598a44-e4f8-421f-80ac-528e39bbe1e5 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691206 Aug 24 03:00:33.795197 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Made reservation on behalf of 1ac6ae42d3d3478aab4103c3629db149 for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:00:33.795900 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:33.799290 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:33.820275 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:33.823133 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=08baa807-6f5d-4e59-891a-d1a97caf8fe9,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:33.831880 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:33.832422 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:33.832751 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:33.833486 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:33.833840 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:33.834174 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:33.835832 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:33.835832 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:33.835832 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:33.836158 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:33.836501 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:33.836822 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:33.860956 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:33.866093 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-4e62c208-1fc8-490d-92f5-d03788ff6733 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/08baa807-6f5d-4e59-891a-d1a97caf8fe9 HTTP/1.1" status: 204 len: 168 time: 0.3508956 Aug 24 03:00:33.866093 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 32994) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:33.935740 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:33.936493 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.015299 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.029310 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.030515 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > segment before_delete 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.030895 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.031637 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.031969 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > port after_create 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.032291 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > port after_delete 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.032625 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > port after_update 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.032985 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > segment after_delete 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.033297 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > subnet after_create 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.033635 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.035899 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > subnet after_update 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.104982 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Pushing event updated for resources: {'SecurityGroup': ['ID=95f0e636-77f1-49df-9524-df0f3645a779,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:34.180053 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Allocated IP 192.168.233.240 (aaad15bb-180d-4948-a96e-c5575545c7de/09b97e47-9929-4642-8f6e-96e83853eb38/3a1f9eaa-07bc-486c-afdd-ae491913e1ea) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:00:34.191172 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > subnet after_create 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.191559 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.191919 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > subnet before_create 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.192532 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Subscribe: > subnet before_update 55550000 {{(pid=111275) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:34.192921 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8711ab0f-364a-4faf-b32f-902626cda653']}} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:34.215480 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9f912ca7-8981-46bc-8e03-7510f43d46b7') {'for_net_delete': True} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:34.215776 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9f912ca7-8981-46bc-8e03-7510f43d46b7') {} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:34.243584 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25719248'] for segment, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.270744 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Releasing vlan 392 on physical network physnet1 to pool {{(pid=111275) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3484247'] for segment, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: from cryptography.utils import int_from_bytes Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: from cryptography.utils import int_from_bytes Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: Traceback (most recent call last): Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: timer() Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: cb(*args, **kw) Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: return func(*args, **kwargs) Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: self._notify() Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: self.callback(batched_events) Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: event.method(event) Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: return f(self, *a, **k) Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._get(url).json() Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: return self.request(url, 'GET', **kwargs) Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:00:34.289647 dv-cinder-803748-8-iscsi neutron-server[111275]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:00:34.376372 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33016) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:34.376778 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.419791 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-9fa2dbe3-80d9-4885-a761-6209b6cc673d admin admin] Deleting subnet d9e864a8-ff3c-45e0-8d7e-5ffa4a457c88 {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:00:34.423284 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9fa2dbe3-80d9-4885-a761-6209b6cc673d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.423411 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Transition to ACTIVE for port object 3a1f9eaa-07bc-486c-afdd-ae491913e1ea will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:00:34.425128 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.431117 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.436033 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33018) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:34.436179 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] 10.222.0.30 "DELETE /v2.0/networks/8711ab0f-364a-4faf-b32f-902626cda653 HTTP/1.1" status: 204 len: 168 time: 0.5695083 Aug 24 03:00:34.472853 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a91834-6607-4111-97e3-83bfecc6984d admin admin] Pushing event deleted for resources: {'Network': ['ID=8711ab0f-364a-4faf-b32f-902626cda653,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:34.489099 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9fa2dbe3-80d9-4885-a761-6209b6cc673d admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.494606 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_v2 [None req-ff9727d2-0092-420a-b272-5bc035756356 admin admin] Deleting subnet f63f4481-6f72-4deb-a46b-57b510710e85 {{(pid=111276) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:00:34.497816 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ff9727d2-0092-420a-b272-5bc035756356 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.528974 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9fa2dbe3-80d9-4885-a761-6209b6cc673d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.534197 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ff9727d2-0092-420a-b272-5bc035756356 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.544860 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ff9727d2-0092-420a-b272-5bc035756356 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.583156 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.669679 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9fa2dbe3-80d9-4885-a761-6209b6cc673d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.681405 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Network aaad15bb-180d-4948-a96e-c5575545c7de is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:00:34.686481 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Pushing event updated for resources: {'Port': ['ID=3a1f9eaa-07bc-486c-afdd-ae491913e1ea,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:34.690962 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:00:34.699103 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fa2dbe3-80d9-4885-a761-6209b6cc673d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d9e864a8-ff3c-45e0-8d7e-5ffa4a457c88,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:34.707920 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9fa2dbe3-80d9-4885-a761-6209b6cc673d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.711896 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-9fa2dbe3-80d9-4885-a761-6209b6cc673d admin admin] 10.222.0.30 "DELETE /v2.0/subnets/d9e864a8-ff3c-45e0-8d7e-5ffa4a457c88 HTTP/1.1" status: 204 len: 168 time: 0.3385553 Aug 24 03:00:34.713876 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33030) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:34.720981 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e61cc30-7ddc-41e3-970a-e8d9d705d997 req-b25a6f31-fac0-4b61-b3e7-0c64932b7da3 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:34.723288 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5e61cc30-7ddc-41e3-970a-e8d9d705d997 req-b25a6f31-fac0-4b61-b3e7-0c64932b7da3 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 936 time: 0.1443136 Aug 24 03:00:34.743033 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:00:34.748571 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:34.749202 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.782118 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ff9727d2-0092-420a-b272-5bc035756356 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for subnet, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.793017 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5e61cc30-7ddc-41e3-970a-e8d9d705d997 req-79c18cd8-c087-4a18-bda1-0589676ab8ea tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589223 Aug 24 03:00:34.793707 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.832788 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff9727d2-0092-420a-b272-5bc035756356 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f63f4481-6f72-4deb-a46b-57b510710e85,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:34.835386 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ff9727d2-0092-420a-b272-5bc035756356 admin admin] Notify callbacks [] for subnet, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.837265 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-ff9727d2-0092-420a-b272-5bc035756356 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/f63f4481-6f72-4deb-a46b-57b510710e85 HTTP/1.1" status: 204 len: 168 time: 0.3998859 Aug 24 03:00:34.840307 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33034) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:34.854645 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-cce8ee52-2cf6-4f56-8659-b42b1f42dc8d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.5532351 Aug 24 03:00:34.900111 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.911409 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['007bf848-97a3-4bd3-bd10-cbdcb8cbf250']}} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:34.927605 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6') {'for_net_delete': True} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:34.928571 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5dd9a14e-2a13-4a57-a0ee-4b7b46c7e8c6') {} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:34.942646 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25719248'] for segment, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.957550 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.962390 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] Releasing vlan 367 on physical network physnet1 to pool {{(pid=111275) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3484247'] for segment, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: Traceback (most recent call last): Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: timer() Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: cb(*args, **kw) Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: return func(*args, **kwargs) Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: self._notify() Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: self.callback(batched_events) Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: event.method(event) Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: return f(self, *a, **k) Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._get(url).json() Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: return self.request(url, 'GET', **kwargs) Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:00:34.973034 dv-cinder-803748-8-iscsi neutron-server[111275]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:00:35.017222 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d82be43a-d6ed-4b67-ac55-c25c2546f0fc req-25f0883a-ac8e-4baa-8530-e16ec2f48731 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:35.022750 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d82be43a-d6ed-4b67-ac55-c25c2546f0fc req-25f0883a-ac8e-4baa-8530-e16ec2f48731 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.1118739 Aug 24 03:00:35.088383 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.106754 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > segment before_delete 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.107131 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.107894 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.108227 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > port after_create 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.108549 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > port after_delete 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.108881 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > port after_update 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.109198 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > segment after_delete 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.109530 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > subnet after_create 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.109871 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.110189 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > subnet after_update 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.126458 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.138177 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.138177 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] 10.222.0.30 "DELETE /v2.0/networks/007bf848-97a3-4bd3-bd10-cbdcb8cbf250 HTTP/1.1" status: 204 len: 168 time: 0.4204440 Aug 24 03:00:35.144507 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff69fa9b-e715-4edd-84ac-1b812bae4801 admin admin] Pushing event deleted for resources: {'Network': ['ID=007bf848-97a3-4bd3-bd10-cbdcb8cbf250,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:35.176726 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > subnet after_create 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.177077 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.177408 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > subnet before_create 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.177763 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Subscribe: > subnet before_update 55550000 {{(pid=111276) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Aug 24 03:00:35.178139 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['00da3521-1685-44fa-85bf-01e14adede93']}} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:35.186184 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d82be43a-d6ed-4b67-ac55-c25c2546f0fc req-ff7ddfa3-84b0-4997-9e25-7909f664a441 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1534321 Aug 24 03:00:35.201150 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4aa4979d-dda2-4b18-bdcb-03c331781325') {'for_net_delete': True} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:35.201448 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4aa4979d-dda2-4b18-bdcb-03c331781325') {} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:35.212299 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-c16f5510-11c0-46d6-859d-c1a395a94217 None None] Provisioning for port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:00:35.216186 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-c16f5510-11c0-46d6-859d-c1a395a94217 None None] Provisioning complete for port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:35.220943 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c16f5510-11c0-46d6-859d-c1a395a94217 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.221170 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25761368'] for segment, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.239554 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.248362 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Releasing vlan 381 on physical network physnet1 to pool {{(pid=111276) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:00:35.248759 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3525699'] for segment, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: from cryptography.utils import int_from_bytes Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: from cryptography.utils import int_from_bytes Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: Traceback (most recent call last): Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: timer() Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: cb(*args, **kw) Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: return func(*args, **kwargs) Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: self._notify() Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: self.callback(batched_events) Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: event.method(event) Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: return f(self, *a, **k) Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._get(url).json() Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: return self.request(url, 'GET', **kwargs) Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:00:35.252776 dv-cinder-803748-8-iscsi neutron-server[111276]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:00:35.255127 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-c16f5510-11c0-46d6-859d-c1a395a94217 None None] Port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:00:35.389489 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.395018 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.396895 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] 10.222.0.30 "DELETE /v2.0/networks/00da3521-1685-44fa-85bf-01e14adede93 HTTP/1.1" status: 204 len: 168 time: 0.5554395 Aug 24 03:00:35.410212 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdaf8a18-1595-4c29-bfe8-1228c060824d admin admin] Pushing event deleted for resources: {'Network': ['ID=00da3521-1685-44fa-85bf-01e14adede93,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:35.647567 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33044) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:35.685379 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-1bfb3b0b-73b9-4f80-b3e5-813f6fd42281 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=050fc06a8c0745b78a8d3f9a9d88ff3f&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0366840 Aug 24 03:00:35.688054 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33046) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:35.734057 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e6055042-ae0a-4668-82be-0aa87ec45726 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.754343 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e6055042-ae0a-4668-82be-0aa87ec45726 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.886863 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33052) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:35.909079 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90de713c-fd95-4f5f-9a5e-83dc0bce4584 req-d77754c0-0eab-4dd1-9838-91c2c5f82c17 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:35.910612 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e6055042-ae0a-4668-82be-0aa87ec45726 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.910731 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-90de713c-fd95-4f5f-9a5e-83dc0bce4584 req-d77754c0-0eab-4dd1-9838-91c2c5f82c17 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 936 time: 0.0497413 Aug 24 03:00:35.913706 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e6055042-ae0a-4668-82be-0aa87ec45726 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:35.914937 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-e6055042-ae0a-4668-82be-0aa87ec45726 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/4c193609-dcd3-47f2-8d2d-5b04db402f74 HTTP/1.1" status: 204 len: 168 time: 0.2259920 Aug 24 03:00:35.938151 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6055042-ae0a-4668-82be-0aa87ec45726 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c193609-dcd3-47f2-8d2d-5b04db402f74,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:35.943186 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-6bde184b-e95e-412d-bdfd-2773dc816322 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b2a25da75ef64218929e077ad77a0faa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0551803 Aug 24 03:00:35.946208 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33056) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:35.967818 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-90de713c-fd95-4f5f-9a5e-83dc0bce4584 req-7ded4378-65d2-4a3e-a364-f40b4c8c0488 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506101 Aug 24 03:00:36.009132 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d7b27888-f52f-41e1-a235-14949d2b8d80 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:36.037420 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d7b27888-f52f-41e1-a235-14949d2b8d80 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:36.212262 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d7b27888-f52f-41e1-a235-14949d2b8d80 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:36.215340 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d7b27888-f52f-41e1-a235-14949d2b8d80 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:36.221082 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-d7b27888-f52f-41e1-a235-14949d2b8d80 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ddd7e35e-b3b2-4dc2-a2f9-99bc925a47b1 HTTP/1.1" status: 204 len: 168 time: 0.2694836 Aug 24 03:00:36.224906 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7b27888-f52f-41e1-a235-14949d2b8d80 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ddd7e35e-b3b2-4dc2-a2f9-99bc925a47b1,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:36.326693 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb17d9ca-ff41-4bab-937d-8bee855fdbd2 req-57b54f31-e1ab-4fb9-b03e-91c75d17e554 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:36.328212 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb17d9ca-ff41-4bab-937d-8bee855fdbd2 req-57b54f31-e1ab-4fb9-b03e-91c75d17e554 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0524330 Aug 24 03:00:36.370332 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb17d9ca-ff41-4bab-937d-8bee855fdbd2 req-381836ca-f5b6-41e0-9c39-7bab348f70cc tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0356894 Aug 24 03:00:37.081084 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-718ae11c-8fba-459b-9603-89ba1c0b2640 req-b95e30f9-ffa7-4562-a60e-914f6e1e6633 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:37.082569 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-718ae11c-8fba-459b-9603-89ba1c0b2640 req-b95e30f9-ffa7-4562-a60e-914f6e1e6633 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 936 time: 0.0478547 Aug 24 03:00:37.105163 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33098) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:37.124983 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-718ae11c-8fba-459b-9603-89ba1c0b2640 req-cd586d11-3b0b-4078-8e9e-3350546e3b19 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362923 Aug 24 03:00:37.145919 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-b72d486f-77a0-42f1-94bd-da776726af65 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=334c1afc7d2a48dfba08cda062bc7b0a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0394914 Aug 24 03:00:37.148569 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33100) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:37.195172 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99542a82-b732-498b-b8cd-d164f7f22848 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:37.215830 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99542a82-b732-498b-b8cd-d164f7f22848 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:37.309536 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33104) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:37.360447 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99542a82-b732-498b-b8cd-d164f7f22848 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:37.363047 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99542a82-b732-498b-b8cd-d164f7f22848 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:37.364185 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-99542a82-b732-498b-b8cd-d164f7f22848 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/df49618c-023f-4c99-b80b-5683ebb90276 HTTP/1.1" status: 204 len: 168 time: 0.2147241 Aug 24 03:00:37.375913 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99542a82-b732-498b-b8cd-d164f7f22848 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df49618c-023f-4c99-b80b-5683ebb90276,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:37.386853 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Request body: {'port': {'device_id': 'd5af1509-b98e-44c3-b607-1518e6fa8577', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:37.419576 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-network', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:37.560714 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Made reservation on behalf of 6b319ec439ef48f18d76e47df6300bc6 for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:00:37.563319 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:37.566086 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:37.574018 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f8c14b6b-1d73-4568-ab0b-c704b8c78da4 req-5e576a6a-0951-4aa7-89bd-b8efb961b125 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1130128 Aug 24 03:00:37.574973 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:37.592940 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aeeb4fa-7c17-463e-b16b-61e285ed9710 req-b6327d3e-d7d1-4606-8e64-1eefe0b6ca8e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:37.594418 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8aeeb4fa-7c17-463e-b16b-61e285ed9710 req-b6327d3e-d7d1-4606-8e64-1eefe0b6ca8e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.1082757 Aug 24 03:00:37.681833 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:37.703309 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:37.743495 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8aeeb4fa-7c17-463e-b16b-61e285ed9710 req-3d2e5fc8-8444-4642-9e38-7087518c6b55 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1220336 Aug 24 03:00:37.774890 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c14b6b-1d73-4568-ab0b-c704b8c78da4 req-559294e4-affe-4ad5-a84a-9062ee010fc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:37.776545 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f8c14b6b-1d73-4568-ab0b-c704b8c78da4 req-559294e4-affe-4ad5-a84a-9062ee010fc9 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 1098 time: 0.1312795 Aug 24 03:00:37.795142 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:37.820676 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] vlan segment allocate from pool success with {'vlan_id': 356, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:00:37.830415 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e62db95-91cd-4252-b52e-b0890d0be853,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:37.835752 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:37.836035 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Added segment f890483e-ac55-4cdc-9004-ef9743d5959e of type vlan for network 72400947-ffa3-49a8-8805-03fdb89d0cfb Aug 24 03:00:37.891769 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:37.951917 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c14b6b-1d73-4568-ab0b-c704b8c78da4 req-5a362793-d019-4a77-a1e0-ceaa819d72d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:37.953425 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f8c14b6b-1d73-4568-ab0b-c704b8c78da4 req-5a362793-d019-4a77-a1e0-ceaa819d72d2 service neutron] 10.222.0.43 "GET /v2.0/networks?id=4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 200 len: 919 time: 0.1270721 Aug 24 03:00:38.024120 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:38.025172 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:38.025900 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:38.029594 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f8c14b6b-1d73-4568-ab0b-c704b8c78da4 req-abd761f6-08f6-44b8-87b3-26beeeb34c65 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=706be5c2-c6fb-496a-ac91-104e4cc11ae7 HTTP/1.1" status: 200 len: 217 time: 0.0602188 Aug 24 03:00:38.087805 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] Pushing event updated for resources: {'Network': ['ID=72400947-ffa3-49a8-8805-03fdb89d0cfb,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:38.094085 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3a1f9eaa-07bc-486c-afdd-ae491913e1ea {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:00:38.098604 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 72400947-ffa3-49a8-8805-03fdb89d0cfb details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:00:38.105032 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:38.114218 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c14b6b-1d73-4568-ab0b-c704b8c78da4 req-8db11c61-87e9-47f5-9bfd-b7edfc68f170 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:38.115642 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f8c14b6b-1d73-4568-ab0b-c704b8c78da4 req-8db11c61-87e9-47f5-9bfd-b7edfc68f170 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4f536c4e-b790-4630-bdc6-867501285c32 HTTP/1.1" status: 200 len: 858 time: 0.0659313 Aug 24 03:00:38.123899 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Transition to ACTIVE for port object 3a1f9eaa-07bc-486c-afdd-ae491913e1ea will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:00:38.165212 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-5f074c3e-dda5-4bba-a8d3-26aa91c65f6e admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.8545709 Aug 24 03:00:38.168533 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f8c14b6b-1d73-4568-ab0b-c704b8c78da4 req-938f7842-0732-4e1d-b229-3dc1bcc734d1 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=4091852f-86f8-4dac-87af-44624502a74d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0400643 Aug 24 03:00:38.169186 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33138) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:38.176921 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-b27a9a28-8244-4d63-b68e-a645f6cfe8e2 admin admin] Request body: {'subnet': {'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-subnet', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:38.274525 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdbf1a02-dcf5-4032-8da1-db93d579af61 req-f5b8b4ec-f55b-4658-b46e-7c5d36de07e6 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:38.275989 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-cdbf1a02-dcf5-4032-8da1-db93d579af61 req-f5b8b4ec-f55b-4658-b46e-7c5d36de07e6 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 936 time: 0.0537443 Aug 24 03:00:38.290317 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f8c14b6b-1d73-4568-ab0b-c704b8c78da4 req-66352f19-817d-49f5-b88a-fdfa33e221d0 service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1060569 Aug 24 03:00:38.313288 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-cdbf1a02-dcf5-4032-8da1-db93d579af61 req-becb59d1-9346-457c-8f78-2b0214822a73 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0307438 Aug 24 03:00:38.365753 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:38.436421 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Pushing event updated for resources: {'Port': ['ID=3a1f9eaa-07bc-486c-afdd-ae491913e1ea,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:38.442894 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f8c14b6b-1d73-4568-ab0b-c704b8c78da4 req-49d02372-32db-4e09-aaca-4129409ffcf1 service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1427310 Aug 24 03:00:38.486821 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b27a9a28-8244-4d63-b68e-a645f6cfe8e2 admin admin] Made reservation on behalf of 6b319ec439ef48f18d76e47df6300bc6 for: {'subnet': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:00:38.489109 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b27a9a28-8244-4d63-b68e-a645f6cfe8e2 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25854793'] for subnet, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:38.610557 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Attempting to bind port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:00:38.611007 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Attempting to bind port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': '497c966f-80df-41e8-af80-77eb55023bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:00:38.611347 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Attempting to bind port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea on network aaad15bb-180d-4948-a96e-c5575545c7de {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:00:38.621957 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea on network aaad15bb-180d-4948-a96e-c5575545c7de not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:00:38.622215 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Attempting to bind port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea on network aaad15bb-180d-4948-a96e-c5575545c7de {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:00:38.630852 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 0, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:00:38.631208 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Checking segment: {'id': '497c966f-80df-41e8-af80-77eb55023bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:00:38.631650 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Bound using segment: {'id': '497c966f-80df-41e8-af80-77eb55023bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:00:38.632079 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Bound port: 3a1f9eaa-07bc-486c-afdd-ae491913e1ea, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '497c966f-80df-41e8-af80-77eb55023bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:00:38.632437 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:38.761249 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] For port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:00:38.773563 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] For port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=3a1f9eaa-07bc-486c-afdd-ae491913e1ea,segment=NetworkSegment(497c966f-80df-41e8-af80-77eb55023bc6),segment_id=497c966f-80df-41e8-af80-77eb55023bc6)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:00:38.857125 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d598cdde-1369-4b62-a9c4-d84fdf9ebeb9 req-cd60e1cf-0372-4895-8398-cffd7647de88 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:38.858598 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d598cdde-1369-4b62-a9c4-d84fdf9ebeb9 req-cd60e1cf-0372-4895-8398-cffd7647de88 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0475266 Aug 24 03:00:38.870121 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b27a9a28-8244-4d63-b68e-a645f6cfe8e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3523558', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25854779'] for subnet, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:38.880347 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:38.900118 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d598cdde-1369-4b62-a9c4-d84fdf9ebeb9 req-48acb2b9-1845-4587-aeec-a08e2698c47b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0353034 Aug 24 03:00:38.949685 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:38.950323 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:38.951782 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] 10.222.0.43 "PUT /v2.0/ports/3a1f9eaa-07bc-486c-afdd-ae491913e1ea HTTP/1.1" status: 200 len: 1098 time: 1.5697033 Aug 24 03:00:38.953962 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd5af1509-b98e-44c3-b607-1518e6fa8577', 'tag': '3a1f9eaa-07bc-486c-afdd-ae491913e1ea'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:00:38.956326 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1717ad95-410a-4f85-87d2-a7ce9e68a1dc" -d '{"events": [{"name": "network-changed", "server_uuid": "d5af1509-b98e-44c3-b607-1518e6fa8577", "tag": "3a1f9eaa-07bc-486c-afdd-ae491913e1ea"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:00:38.996182 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b27a9a28-8244-4d63-b68e-a645f6cfe8e2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=465e9b83-ccde-4ea3-8e80-86590891b03c,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:39.010507 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4095192-0bc4-4717-a596-0d37533e13a8 service neutron] Pushing event updated for resources: {'Port': ['ID=3a1f9eaa-07bc-486c-afdd-ae491913e1ea,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:39.012797 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b27a9a28-8244-4d63-b68e-a645f6cfe8e2 admin admin] Checking segment: {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:00:39.013159 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b27a9a28-8244-4d63-b68e-a645f6cfe8e2 admin admin] Network hostable DHCP agents. Network: 72400947-ffa3-49a8-8805-03fdb89d0cfb, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111276) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:00:39.021633 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:00:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-67805244-2a5f-4c3a-92db-d3d5bf3345a1 x-openstack-request-id: req-67805244-2a5f-4c3a-92db-d3d5bf3345a1 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:00:39.034925 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d5af1509-b98e-44c3-b607-1518e6fa8577", "tag": "3a1f9eaa-07bc-486c-afdd-ae491913e1ea", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:00:39.042794 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-67805244-2a5f-4c3a-92db-d3d5bf3345a1 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:00:39.042794 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd5af1509-b98e-44c3-b607-1518e6fa8577', 'tag': '3a1f9eaa-07bc-486c-afdd-ae491913e1ea', 'status': 'completed', 'code': 200} Aug 24 03:00:39.098918 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1717ad95-410a-4f85-87d2-a7ce9e68a1dc req-97c07252-fe63-40fa-9b6f-6c776ac5491d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:39.100528 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1717ad95-410a-4f85-87d2-a7ce9e68a1dc req-97c07252-fe63-40fa-9b6f-6c776ac5491d service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=1ac6ae42d3d3478aab4103c3629db149&device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 1101 time: 0.0541213 Aug 24 03:00:39.137399 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1717ad95-410a-4f85-87d2-a7ce9e68a1dc req-6ad48be8-c66c-44d3-8fc2-eb830850aea4 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=1ac6ae42d3d3478aab4103c3629db149&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0220134 Aug 24 03:00:39.138553 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b27a9a28-8244-4d63-b68e-a645f6cfe8e2 admin admin] Network 72400947-ffa3-49a8-8805-03fdb89d0cfb is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111276) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:00:39.248450 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-b27a9a28-8244-4d63-b68e-a645f6cfe8e2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 72400947-ffa3-49a8-8805-03fdb89d0cfb) {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:00:39.258870 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b27a9a28-8244-4d63-b68e-a645f6cfe8e2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:39.259451 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b27a9a28-8244-4d63-b68e-a645f6cfe8e2 admin admin] Notify callbacks [] for subnet, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:39.262686 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f169a89-6e77-45fc-b0c4-55268ca60187 None None] Network 72400947-ffa3-49a8-8805-03fdb89d0cfb requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:00:39.267769 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1717ad95-410a-4f85-87d2-a7ce9e68a1dc req-751d3b7c-9be6-49dc-b5ea-d85ad4dd879b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:39.269420 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1717ad95-410a-4f85-87d2-a7ce9e68a1dc req-751d3b7c-9be6-49dc-b5ea-d85ad4dd879b service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1190531 Aug 24 03:00:39.353475 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11819117-ee35-4a68-b54b-683f8c08a705 req-b575b009-405d-4365-af0e-99c3f3d95fd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:39.359897 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-b575b009-405d-4365-af0e-99c3f3d95fd6 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=1ac6ae42d3d3478aab4103c3629db149&device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 1101 time: 0.0443780 Aug 24 03:00:39.412894 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-b27a9a28-8244-4d63-b68e-a645f6cfe8e2 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 1.2421627 Aug 24 03:00:39.414805 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-066c86ff-f5ac-472a-9a3f-999104533fb3 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.240&port_id=3a1f9eaa-07bc-486c-afdd-ae491913e1ea HTTP/1.1" status: 200 len: 217 time: 0.0502324 Aug 24 03:00:39.415766 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33176) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:39.420097 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:39.435892 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc8ebca0a-8efd-5c96-8278-1a4ec08c6f82-72400947-ffa3-49a8-8805-03fdb89d0cfb', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c'}]}} from dv-cinder-803748-8-iscsi. {{(pid=111277) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Aug 24 03:00:39.436772 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:39.448745 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-368f0261-d94f-4802-9584-4a785c7cb300 req-c5c4894a-e9f1-4ebb-9dbf-a556a95ba2d3 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:39.450243 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-368f0261-d94f-4802-9584-4a785c7cb300 req-c5c4894a-e9f1-4ebb-9dbf-a556a95ba2d3 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 948 time: 0.0552111 Aug 24 03:00:39.488528 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4674cff-b66f-444f-ad65-7a496f027d6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:39.490009 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-e4674cff-b66f-444f-ad65-7a496f027d6f service neutron] 10.222.0.43 "GET /v2.0/subnets?id=09b97e47-9929-4642-8f6e-96e83853eb38 HTTP/1.1" status: 200 len: 843 time: 0.0657094 Aug 24 03:00:39.495210 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-368f0261-d94f-4802-9584-4a785c7cb300 req-c83843f9-137c-4497-abc6-7bf74f338675 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386515 Aug 24 03:00:39.547569 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11819117-ee35-4a68-b54b-683f8c08a705 req-8c025caf-9fb7-4625-af37-2db04976a8bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:39.549061 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-8c025caf-9fb7-4625-af37-2db04976a8bf service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=aaad15bb-180d-4948-a96e-c5575545c7de&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0409424 Aug 24 03:00:39.610441 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.db_base_plugin_common [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Allocated IP 172.20.0.2 (72400947-ffa3-49a8-8805-03fdb89d0cfb/465e9b83-ccde-4ea3-8e80-86590891b03c/d69eed58-c0db-4143-a55f-670858fac28b) {{(pid=111277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:00:39.617790 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-560365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32717'] for router, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:39.618958 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-560249', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-569518', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-437890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32692'] for router, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:39.691479 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:39.705373 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-a7021172-5d20-4943-a03b-d6d3e94aec34 service neutron] 10.222.0.43 "GET /v2.0/networks/aaad15bb-180d-4948-a96e-c5575545c7de?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1470017 Aug 24 03:00:39.800914 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Notify callbacks [] for port, precommit_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:39.815864 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Transition to ACTIVE for port object d69eed58-c0db-4143-a55f-670858fac28b will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:00:39.856233 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Transition to ACTIVE for port object d69eed58-c0db-4143-a55f-670858fac28b will not be triggered until provisioned by entity DHCP. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:00:39.892678 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33194) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:39.944321 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:39.994471 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Network 72400947-ffa3-49a8-8805-03fdb89d0cfb is already hosted by enough agents. {{(pid=111277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:00:39.999816 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.base_scheduler [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Resources bound (agent type, host, resource id): {{(pid=111277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:00:40.003810 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Received port after_create {{(pid=111277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:00:40.028304 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0236efad-82ae-40fe-b5b5-7c458ea91e1f admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.037365 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Pushing event updated for resources: {'Port': ['ID=d69eed58-c0db-4143-a55f-670858fac28b,revision_number=1']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:40.048907 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:40.049281 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:40.049838 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:40.050181 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:40.050560 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:40.050894 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:40.051224 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:40.051551 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:40.051875 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:40.052122 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8b2d374-1ace-4ddf-aab2-a3fa2291df94 req-f60a6f0e-a8ce-47ef-a6a6-4214f58e8b2d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:40.052243 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:40.052511 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:40.052833 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:40.053988 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c8b2d374-1ace-4ddf-aab2-a3fa2291df94 req-f60a6f0e-a8ce-47ef-a6a6-4214f58e8b2d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0823100 Aug 24 03:00:40.122350 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c8b2d374-1ace-4ddf-aab2-a3fa2291df94 req-bda98d5a-3c45-4bc2-bca7-6c590bd0736d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502117 Aug 24 03:00:40.135919 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11819117-ee35-4a68-b54b-683f8c08a705 req-bf0abfe5-0b45-4d90-b171-1f50c431ebed service neutron] 10.222.0.43 "GET /v2.0/networks/aaad15bb-180d-4948-a96e-c5575545c7de?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4225378 Aug 24 03:00:40.196249 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0236efad-82ae-40fe-b5b5-7c458ea91e1f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.203355 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Attempting to bind port d69eed58-c0db-4143-a55f-670858fac28b on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:00:40.203719 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Attempting to bind port d69eed58-c0db-4143-a55f-670858fac28b by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:00:40.204078 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Attempting to bind port d69eed58-c0db-4143-a55f-670858fac28b on network 72400947-ffa3-49a8-8805-03fdb89d0cfb {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:00:40.207287 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.209102 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 0, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:00:40.210349 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Checking segment: {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:00:40.210934 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.211957 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Bound using segment: {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:00:40.212683 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Bound port: d69eed58-c0db-4143-a55f-670858fac28b, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:00:40.214278 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.262813 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0236efad-82ae-40fe-b5b5-7c458ea91e1f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.287160 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] For port d69eed58-c0db-4143-a55f-670858fac28b, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:00:40.291241 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] For port d69eed58-c0db-4143-a55f-670858fac28b, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=d69eed58-c0db-4143-a55f-670858fac28b,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:00:40.303587 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0236efad-82ae-40fe-b5b5-7c458ea91e1f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ffd36fbe-b0d1-431b-9fd9-011e3f79e959,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:40.307816 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-0236efad-82ae-40fe-b5b5-7c458ea91e1f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b45439c458a54a3b9be634204be53a09&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4141309 Aug 24 03:00:40.310579 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33202) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:40.358945 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-46b075ce-1ccc-4db8-8b04-9d586e30fa25 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.379707 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-46b075ce-1ccc-4db8-8b04-9d586e30fa25 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.384472 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.456346 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80ec699b-b55b-45ec-9e39-8234271a3c66 None None] Pushing event updated for resources: {'Port': ['ID=d69eed58-c0db-4143-a55f-670858fac28b,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:40.497715 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-46b075ce-1ccc-4db8-8b04-9d586e30fa25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.500446 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-46b075ce-1ccc-4db8-8b04-9d586e30fa25 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.501617 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-46b075ce-1ccc-4db8-8b04-9d586e30fa25 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ffd36fbe-b0d1-431b-9fd9-011e3f79e959 HTTP/1.1" status: 204 len: 168 time: 0.1901040 Aug 24 03:00:40.510678 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46b075ce-1ccc-4db8-8b04-9d586e30fa25 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ffd36fbe-b0d1-431b-9fd9-011e3f79e959,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:40.510821 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.536000 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.694932 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4584494c-e66d-4928-a015-5d95fe07aa30 req-7a0d903c-ced5-4fe6-9597-552014d4aa7e tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:40.696682 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4584494c-e66d-4928-a015-5d95fe07aa30 req-7a0d903c-ced5-4fe6-9597-552014d4aa7e tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 948 time: 0.1141982 Aug 24 03:00:40.716805 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Allocated IP 172.27.2.91 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/10411837-b2f0-4732-b5be-89d265552b35) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:00:40.818190 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4584494c-e66d-4928-a015-5d95fe07aa30 req-f8ef032b-e391-4b8c-ba50-4f1aa3e2ec36 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957947 Aug 24 03:00:40.894920 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:40.974214 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device d69eed58-c0db-4143-a55f-670858fac28b up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:00:41.007861 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:41.046754 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:00:41.049517 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:00:41.055739 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:00:41.085757 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Pushing event updated for resources: {'Port': ['ID=10411837-b2f0-4732-b5be-89d265552b35,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:41.120459 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port d69eed58-c0db-4143-a55f-670858fac28b completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:00:41.284553 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e58d2f7-9671-45a4-a2be-bfbc67596f6a req-2fb1364b-ef7b-4d8d-b034-05c1907e9cbb tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:41.286109 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9e58d2f7-9671-45a4-a2be-bfbc67596f6a req-2fb1364b-ef7b-4d8d-b034-05c1907e9cbb tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0668440 Aug 24 03:00:41.327317 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9e58d2f7-9671-45a4-a2be-bfbc67596f6a req-f53b38d2-74a3-48d3-927e-e87ce3d19b2a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0349267 Aug 24 03:00:41.413722 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-482a70e0-7fca-4c76-8bdb-3564754718f8 None None] Network 72400947-ffa3-49a8-8805-03fdb89d0cfb requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:00:41.519900 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:41.589320 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-94c7a71e-6732-4dc7-a919-2069acbcd312 None None] Provisioning for port d69eed58-c0db-4143-a55f-670858fac28b completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:00:41.596197 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-94c7a71e-6732-4dc7-a919-2069acbcd312 None None] Provisioning complete for port d69eed58-c0db-4143-a55f-670858fac28b triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:41.596629 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-94c7a71e-6732-4dc7-a919-2069acbcd312 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:41.685040 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-94c7a71e-6732-4dc7-a919-2069acbcd312 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:41.719096 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-94c7a71e-6732-4dc7-a919-2069acbcd312 None None] For port d69eed58-c0db-4143-a55f-670858fac28b, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=d69eed58-c0db-4143-a55f-670858fac28b,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:41.749941 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-560242', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-569595'] for router, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:41.801075 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-94c7a71e-6732-4dc7-a919-2069acbcd312 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:41.876222 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94c7a71e-6732-4dc7-a919-2069acbcd312 None None] Pushing event updated for resources: {'Port': ['ID=d69eed58-c0db-4143-a55f-670858fac28b,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:41.928308 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-2d228e67-3d0e-46f5-bbfd-c3f09f4dd20e None None] Provisioning complete for port d69eed58-c0db-4143-a55f-670858fac28b triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:41.936182 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-2d228e67-3d0e-46f5-bbfd-c3f09f4dd20e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:41.994738 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70211a86-d845-495b-99f8-a85cc468351d req-8562a723-0a9f-4661-b6e8-c469ec807edc tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:41.996300 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-70211a86-d845-495b-99f8-a85cc468351d req-8562a723-0a9f-4661-b6e8-c469ec807edc tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 948 time: 0.0742137 Aug 24 03:00:42.020110 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Router 0195ba54-f802-48e9-b0df-bdb173e4aa57 is scheduled to L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 with binding_index 1 {{(pid=111276) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Aug 24 03:00:42.045516 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-70211a86-d845-495b-99f8-a85cc468351d req-adefbfe4-b764-413e-b550-f78f22e1bcc8 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427682 Aug 24 03:00:42.153290 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:00:42.161921 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Sync routers for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:00:42.175970 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:00:42.176585 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:00:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:42.246446 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] Notify callbacks [] for router, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:42.248038 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-7fe7c20b-cbf7-4b9d-93e6-77873ac6cf3a admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 2.8311710 Aug 24 03:00:42.250805 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33282) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:42.295347 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:00:42.495191 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:41Z', 'revision_number': 3, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:42.503104 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-815947a9-5e26-4981-b35e-9247d5843331 req-6a5cbf6f-0066-4ee4-b5f0-9cb65ea54710 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:42.504560 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-815947a9-5e26-4981-b35e-9247d5843331 req-6a5cbf6f-0066-4ee4-b5f0-9cb65ea54710 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0918715 Aug 24 03:00:42.521241 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Checking router: 0195ba54-f802-48e9-b0df-bdb173e4aa57 for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:00:42.524489 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Updating router 0195ba54-f802-48e9-b0df-bdb173e4aa57 port 10411837-b2f0-4732-b5be-89d265552b35 binding host dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:00:42.548321 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:42.598233 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-815947a9-5e26-4981-b35e-9247d5843331 req-04c6273b-33a6-4ad2-9e83-5d52eacde5e9 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0858853 Aug 24 03:00:42.782348 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:42.822669 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Notify callbacks [] for port, precommit_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:42.833254 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.provisioning_blocks [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Transition to ACTIVE for port object 10411837-b2f0-4732-b5be-89d265552b35 will not be triggered until provisioned by entity L2. {{(pid=111278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:00:42.908539 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device d69eed58-c0db-4143-a55f-670858fac28b up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:00:42.911252 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:42.968968 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port d69eed58-c0db-4143-a55f-670858fac28b triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:42.974629 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:42.999605 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Pushing event updated for resources: {'Port': ['ID=10411837-b2f0-4732-b5be-89d265552b35,revision_number=2']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:43.007478 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Attempting to bind port 10411837-b2f0-4732-b5be-89d265552b35 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:00:43.007861 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Attempting to bind port 10411837-b2f0-4732-b5be-89d265552b35 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:00:43.008237 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Attempting to bind port 10411837-b2f0-4732-b5be-89d265552b35 on network 63097abe-4b2c-457b-a244-629c1feb1fe5 {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:00:43.014946 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:43.015324 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:43.015982 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:43.016622 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:43.017113 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:43.017623 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:43.018138 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:43.018624 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:43.019257 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:43.019754 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:43.020093 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:43.020428 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:00:43.025507 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 0, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:00:43.025924 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Checking segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:00:43.026494 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:43.026899 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Bound using segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:00:43.027388 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Bound port: 10411837-b2f0-4732-b5be-89d265552b35, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:00:43.027973 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:43.088199 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] For port 10411837-b2f0-4732-b5be-89d265552b35, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:00:43.091932 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] For port 10411837-b2f0-4732-b5be-89d265552b35, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=10411837-b2f0-4732-b5be-89d265552b35,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:00:43.177880 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:43.220082 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53894f53-85eb-4832-9bdd-e4b91c4dece3 req-7bc1dbe3-165a-4ed8-8736-553e9a2155d4 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:43.221715 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-53894f53-85eb-4832-9bdd-e4b91c4dece3 req-7bc1dbe3-165a-4ed8-8736-553e9a2155d4 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 948 time: 0.0881348 Aug 24 03:00:43.226604 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:00:43.227249 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:00:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:43.242757 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Allocated IP 172.20.0.1 (72400947-ffa3-49a8-8805-03fdb89d0cfb/465e9b83-ccde-4ea3-8e80-86590891b03c/6782d692-12a1-4a0e-a724-1f35a1861898) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:00:43.285748 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b287bf-db69-4ee1-988c-5c1b6631b72e None None] Pushing event updated for resources: {'Port': ['ID=10411837-b2f0-4732-b5be-89d265552b35,revision_number=3']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:43.291616 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-53894f53-85eb-4832-9bdd-e4b91c4dece3 req-b158d703-d2f6-4075-a05a-9684bf70555c tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0616302 Aug 24 03:00:43.359696 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:00:43.376030 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:43.395254 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Transition to ACTIVE for port object 6782d692-12a1-4a0e-a724-1f35a1861898 will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:00:43.499396 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:43.547645 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Network 72400947-ffa3-49a8-8805-03fdb89d0cfb is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:00:43.547830 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:41Z', 'revision_number': 3, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:43.550875 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:00:43.555503 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:00:43.582688 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Pushing event updated for resources: {'Port': ['ID=6782d692-12a1-4a0e-a724-1f35a1861898,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:43.597571 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8c37283-fb52-4efc-831f-fdbaab4584ed None None] The sync data for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi is: [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:41Z', 'revision_number': 3, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:00:43.604633 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-571748'] for router_interface, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:43.754481 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a3ca51-d150-44f7-9ead-956f502f319a req-82d4e91f-cc7f-4feb-966b-d07ae6d6a2e0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:43.755986 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e8a3ca51-d150-44f7-9ead-956f502f319a req-82d4e91f-cc7f-4feb-966b-d07ae6d6a2e0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0620339 Aug 24 03:00:43.800728 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e8a3ca51-d150-44f7-9ead-956f502f319a req-20877d91-f7ff-4ca5-b21c-d4836c1f4def tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378215 Aug 24 03:00:43.902184 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:43.989196 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-73d7a32f-da20-4ceb-a436-cca229bac0df None None] Provisioning for port 6782d692-12a1-4a0e-a724-1f35a1861898 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:00:43.995772 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-73d7a32f-da20-4ceb-a436-cca229bac0df None None] Provisioning complete for port 6782d692-12a1-4a0e-a724-1f35a1861898 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:43.996142 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-73d7a32f-da20-4ceb-a436-cca229bac0df None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:44.080846 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-73d7a32f-da20-4ceb-a436-cca229bac0df None None] Port 6782d692-12a1-4a0e-a724-1f35a1861898 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:00:44.131213 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:44.194696 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:44.263936 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Pushing event updated for resources: {'Port': ['ID=6782d692-12a1-4a0e-a724-1f35a1861898,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:44.268223 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-748278', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-571822'] for router_interface, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:44.373750 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Network 72400947-ffa3-49a8-8805-03fdb89d0cfb is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:00:44.376354 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:00:44.433819 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7f8141f-ea5e-49a9-9f14-c7806d70a1cb req-8387b166-7cb7-47c0-b4ac-47829b0bb7bb tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:44.441786 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f7f8141f-ea5e-49a9-9f14-c7806d70a1cb req-8387b166-7cb7-47c0-b4ac-47829b0bb7bb tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 948 time: 0.0665038 Aug 24 03:00:44.485458 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f7f8141f-ea5e-49a9-9f14-c7806d70a1cb req-dc3e6ce0-4258-44e1-866e-d3762f9725ed tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426357 Aug 24 03:00:44.540321 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Router 0195ba54-f802-48e9-b0df-bdb173e4aa57 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:00:44.625796 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-63b7829b-ce63-4c31-824b-717f47507e95 None None] Provisioning complete for port 6782d692-12a1-4a0e-a724-1f35a1861898 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:44.626169 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-63b7829b-ce63-4c31-824b-717f47507e95 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:44.652836 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:00:44.658169 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-4ed0e85b-a57b-479b-a47a-6628080f6977 admin admin] 10.222.0.30 "PUT /v2.0/routers/0195ba54-f802-48e9-b0df-bdb173e4aa57/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4062715 Aug 24 03:00:44.667437 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-63b7829b-ce63-4c31-824b-717f47507e95 None None] Port 6782d692-12a1-4a0e-a724-1f35a1861898 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:00:44.889910 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 10411837-b2f0-4732-b5be-89d265552b35 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:00:45.018360 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 10411837-b2f0-4732-b5be-89d265552b35 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:00:45.024048 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 10411837-b2f0-4732-b5be-89d265552b35 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:45.024425 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:45.105005 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:45.124474 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port 10411837-b2f0-4732-b5be-89d265552b35, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=10411837-b2f0-4732-b5be-89d265552b35,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:45.189255 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:45.238218 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=10411837-b2f0-4732-b5be-89d265552b35,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:45.252163 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Sync routers for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:00:45.260613 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33360) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:45.263701 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:00:45.272441 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:00:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:45.272972 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-bce32f8b-d142-44fd-a400-d9f692093991 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Request body: {'security_group': {'name': 'tempest-securitygroup--97670715', 'description': 'tempest-description--2064050402'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:45.349082 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eff40ad-0d3f-4562-abef-afbf069d1ce1 req-38ec1992-869d-40de-98a2-bd76c798dfb1 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:45.351133 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0eff40ad-0d3f-4562-abef-afbf069d1ce1 req-38ec1992-869d-40de-98a2-bd76c798dfb1 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0498750 Aug 24 03:00:45.372422 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:00:45.377607 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bce32f8b-d142-44fd-a400-d9f692093991 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:45.403086 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0eff40ad-0d3f-4562-abef-afbf069d1ce1 req-bf59d194-af7e-45b6-9757-95461277cbf0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445671 Aug 24 03:00:45.463144 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bce32f8b-d142-44fd-a400-d9f692093991 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:45.543294 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bce32f8b-d142-44fd-a400-d9f692093991 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:45.581599 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce32f8b-d142-44fd-a400-d9f692093991 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a1448037-be52-4652-b9f5-5fdd1b21a769,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:45.594418 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 2, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:45.620866 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Checking router: 0195ba54-f802-48e9-b0df-bdb173e4aa57 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:00:45.621181 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Updating router 0195ba54-f802-48e9-b0df-bdb173e4aa57 port 6782d692-12a1-4a0e-a724-1f35a1861898 binding host dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:00:45.622956 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a8553f2-0cdd-45ce-852a-7657175837f6 req-46524d74-bacd-41b4-b06c-4fb5f34c4092 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:45.624451 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3a8553f2-0cdd-45ce-852a-7657175837f6 req-46524d74-bacd-41b4-b06c-4fb5f34c4092 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 948 time: 0.0484140 Aug 24 03:00:45.649280 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:45.663742 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3a8553f2-0cdd-45ce-852a-7657175837f6 req-13f4d959-bb27-4e46-addc-b3e0c7c25ec4 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328343 Aug 24 03:00:45.684016 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bce32f8b-d142-44fd-a400-d9f692093991 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:45.684016 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-bce32f8b-d142-44fd-a400-d9f692093991 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1778 time: 0.4141645 Aug 24 03:00:45.684016 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33368) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:45.688510 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-7a773cb3-3c2a-48e1-979a-438eec1c1d03 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Request body: {'security_group_rule': {'security_group_id': 'a1448037-be52-4652-b9f5-5fdd1b21a769', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:45.802034 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7a773cb3-3c2a-48e1-979a-438eec1c1d03 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:45.870124 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7a773cb3-3c2a-48e1-979a-438eec1c1d03 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:45.914388 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Notify callbacks [] for port, precommit_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:45.923784 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Transition to ACTIVE for port object 6782d692-12a1-4a0e-a724-1f35a1861898 will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:00:45.960730 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7a773cb3-3c2a-48e1-979a-438eec1c1d03 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:45.978874 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a773cb3-3c2a-48e1-979a-438eec1c1d03 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=04424c52-91cb-41ce-828e-a113c8a3f814,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:46.126396 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:46.143572 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7a773cb3-3c2a-48e1-979a-438eec1c1d03 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:46.145090 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-7a773cb3-3c2a-48e1-979a-438eec1c1d03 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4648051 Aug 24 03:00:46.147883 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33372) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:46.152980 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-3d6dc85f-c5b3-46d0-8397-a4b71e86d3fd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Request body: {'security_group_rule': {'security_group_id': 'a1448037-be52-4652-b9f5-5fdd1b21a769', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:46.175009 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82c50146-2354-417f-ad92-1772e665fc50 None None] Pushing event updated for resources: {'Port': ['ID=6782d692-12a1-4a0e-a724-1f35a1861898,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:46.227075 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Attempting to bind port 6782d692-12a1-4a0e-a724-1f35a1861898 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:00:46.227439 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Attempting to bind port 6782d692-12a1-4a0e-a724-1f35a1861898 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:00:46.227823 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Attempting to bind port 6782d692-12a1-4a0e-a724-1f35a1861898 on network 72400947-ffa3-49a8-8805-03fdb89d0cfb {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:00:46.233200 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 0, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:00:46.233570 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Checking segment: {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:00:46.233998 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:46.234382 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Bound using segment: {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:00:46.234846 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Bound port: 6782d692-12a1-4a0e-a724-1f35a1861898, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:00:46.235224 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:46.304644 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] For port 6782d692-12a1-4a0e-a724-1f35a1861898, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:00:46.308004 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3d6dc85f-c5b3-46d0-8397-a4b71e86d3fd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:46.310855 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] For port 6782d692-12a1-4a0e-a724-1f35a1861898, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=6782d692-12a1-4a0e-a724-1f35a1861898,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:00:46.373678 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3d6dc85f-c5b3-46d0-8397-a4b71e86d3fd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:46.383697 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:46.440720 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3d6dc85f-c5b3-46d0-8397-a4b71e86d3fd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:46.459455 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d6dc85f-c5b3-46d0-8397-a4b71e86d3fd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1532140a-75a7-416f-a0f4-278e6e7cdc11,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:46.462052 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82c50146-2354-417f-ad92-1772e665fc50 None None] Pushing event updated for resources: {'Port': ['ID=6782d692-12a1-4a0e-a724-1f35a1861898,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:46.466072 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:00:46.466690 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:00:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:46.533044 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6305718d-8b72-439d-aaf3-10100bb750c0 req-8cc4dcfb-b169-4bb0-aacf-2ded12c8891f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:46.534501 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6305718d-8b72-439d-aaf3-10100bb750c0 req-8cc4dcfb-b169-4bb0-aacf-2ded12c8891f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0552757 Aug 24 03:00:46.539336 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3d6dc85f-c5b3-46d0-8397-a4b71e86d3fd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:46.543412 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-3d6dc85f-c5b3-46d0-8397-a4b71e86d3fd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3917298 Aug 24 03:00:46.543693 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33380) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:46.548337 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Request body: {'floatingip': {'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:00:46.587661 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6305718d-8b72-439d-aaf3-10100bb750c0 req-4426016a-13a7-4ccb-a317-0389bd79aba5 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422919 Aug 24 03:00:46.590805 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:00:46.651931 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:46.762138 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:46.798677 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30d8a9d-8c61-41f7-9f5e-e5bcbae7fd04 req-cda8c7ce-c5c9-434b-90c8-b27b41ae67b0 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:46.800596 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a30d8a9d-8c61-41f7-9f5e-e5bcbae7fd04 req-cda8c7ce-c5c9-434b-90c8-b27b41ae67b0 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 948 time: 0.0683415 Aug 24 03:00:46.816057 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:46Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:00:46.846356 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a30d8a9d-8c61-41f7-9f5e-e5bcbae7fd04 req-0ead80b2-f42a-4bc7-8477-2e8c90a34a13 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391235 Aug 24 03:00:46.846753 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fccee3b-34b4-4d9a-8689-410e63e36709 None None] The sync data for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi is: [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:46Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:00:46.888228 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Allocated IP 172.27.2.83 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/926903b3-b9d8-4678-887c-330d4b85073b) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:00:46.929136 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 10411837-b2f0-4732-b5be-89d265552b35 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:00:46.979977 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 10411837-b2f0-4732-b5be-89d265552b35 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:46.980604 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:47.022016 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:47.189604 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:47.227521 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:00:47.230287 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:00:47.234084 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:00:47.264659 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event updated for resources: {'Port': ['ID=926903b3-b9d8-4678-887c-330d4b85073b,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:47.329779 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:47.473821 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:47.652583 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:47.753837 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9540e0a-1e66-4067-83fa-0abfd00d1b72 req-e73bbdb3-cfab-4f2a-aa09-83178c6b3c4a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:47.755300 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f9540e0a-1e66-4067-83fa-0abfd00d1b72 req-e73bbdb3-cfab-4f2a-aa09-83178c6b3c4a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0651867 Aug 24 03:00:47.797386 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:47.831872 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f9540e0a-1e66-4067-83fa-0abfd00d1b72 req-586c8a2c-7cb9-4c60-b9ca-15487e36852e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699646 Aug 24 03:00:47.881421 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event updated for resources: {'Port': ['ID=926903b3-b9d8-4678-887c-330d4b85073b,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:47.891909 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:47.967810 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72d0325d-8512-4ec6-83d3-b69a14ed9ef9 req-d84393c2-d69e-4927-9d91-328e7923ebea tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:47.969314 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-72d0325d-8512-4ec6-83d3-b69a14ed9ef9 req-d84393c2-d69e-4927-9d91-328e7923ebea tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 948 time: 0.0495424 Aug 24 03:00:47.977723 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:47.984278 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-0d96a4d3-f262-4858-bbde-6be6e52c9356 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.4342606 Aug 24 03:00:48.023492 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-72d0325d-8512-4ec6-83d3-b69a14ed9ef9 req-7b5477fb-b12a-42ad-b099-306191f678b3 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362175 Aug 24 03:00:48.927338 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 6782d692-12a1-4a0e-a724-1f35a1861898 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:00:49.012427 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c6bdee-3fa8-4083-9569-faab2a8eafc4 req-280c4cc8-1854-45a2-9106-00ae162a3ffe tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:49.013933 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-45c6bdee-3fa8-4083-9569-faab2a8eafc4 req-280c4cc8-1854-45a2-9106-00ae162a3ffe tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0513701 Aug 24 03:00:49.056772 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-45c6bdee-3fa8-4083-9569-faab2a8eafc4 req-4e63f71d-75e1-4d69-a4c1-d138bb906c5b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0349121 Aug 24 03:00:49.097374 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 6782d692-12a1-4a0e-a724-1f35a1861898 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:00:49.106980 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 6782d692-12a1-4a0e-a724-1f35a1861898 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:49.107852 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:49.163321 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ff1eceb-3f9b-4d76-ba78-52f67a5e82b2 req-72c94bad-c961-40af-b7d9-2267d54530b2 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:49.165065 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8ff1eceb-3f9b-4d76-ba78-52f67a5e82b2 req-72c94bad-c961-40af-b7d9-2267d54530b2 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 948 time: 0.0512531 Aug 24 03:00:49.189759 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:49.208408 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8ff1eceb-3f9b-4d76-ba78-52f67a5e82b2 req-f17b046f-a863-4c19-9401-31324803bc6e tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0371807 Aug 24 03:00:49.228051 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port 6782d692-12a1-4a0e-a724-1f35a1861898, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=6782d692-12a1-4a0e-a724-1f35a1861898,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:49.321309 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:49.375043 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=6782d692-12a1-4a0e-a724-1f35a1861898,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:50.874030 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 6782d692-12a1-4a0e-a724-1f35a1861898 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:00:50.920625 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 6782d692-12a1-4a0e-a724-1f35a1861898 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:50.921004 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:51.147941 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 3a1f9eaa-07bc-486c-afdd-ae491913e1ea details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:00:51.241991 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=3a1f9eaa-07bc-486c-afdd-ae491913e1ea,segment=NetworkSegment(497c966f-80df-41e8-af80-77eb55023bc6),segment_id=497c966f-80df-41e8-af80-77eb55023bc6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:51.251819 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '3a1f9eaa-07bc-486c-afdd-ae491913e1ea', 'network_id': 'aaad15bb-180d-4948-a96e-c5575545c7de', 'port_id': '3a1f9eaa-07bc-486c-afdd-ae491913e1ea', 'mac_address': 'fa:16:3e:21:ba:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 373, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '09b97e47-9929-4642-8f6e-96e83853eb38', 'ip_address': '192.168.233.240'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:00:51.288700 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:51.309031 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3a1f9eaa-07bc-486c-afdd-ae491913e1ea {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:00:51.331070 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=3a1f9eaa-07bc-486c-afdd-ae491913e1ea,segment=NetworkSegment(497c966f-80df-41e8-af80-77eb55023bc6),segment_id=497c966f-80df-41e8-af80-77eb55023bc6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:51.446026 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-8e46b721-167b-4456-859f-4415b043dc30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:51.451482 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:51.500912 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=3a1f9eaa-07bc-486c-afdd-ae491913e1ea,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:51.554882 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33506) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:51.664611 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a21b5105-d9eb-42c8-9adf-b249bd81b193 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:51.749517 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a21b5105-d9eb-42c8-9adf-b249bd81b193 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:51.845784 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a21b5105-d9eb-42c8-9adf-b249bd81b193 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:51.886799 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-a21b5105-d9eb-42c8-9adf-b249bd81b193 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=8b88e6b818394356989060ee0a34900a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3308551 Aug 24 03:00:51.887718 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a21b5105-d9eb-42c8-9adf-b249bd81b193 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dfe0c30b-38a4-412e-b2dc-5981664406f9,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:51.889529 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33512) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:51.939912 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-96cf4a95-79cc-4b0d-a550-2c125a5eee40 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:51.959980 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-96cf4a95-79cc-4b0d-a550-2c125a5eee40 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:52.074964 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-96cf4a95-79cc-4b0d-a550-2c125a5eee40 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:52.079280 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-96cf4a95-79cc-4b0d-a550-2c125a5eee40 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:52.079280 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-96cf4a95-79cc-4b0d-a550-2c125a5eee40 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/dfe0c30b-38a4-412e-b2dc-5981664406f9 HTTP/1.1" status: 204 len: 168 time: 0.1882429 Aug 24 03:00:52.088953 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96cf4a95-79cc-4b0d-a550-2c125a5eee40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dfe0c30b-38a4-412e-b2dc-5981664406f9,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:52.795494 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33524) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:52.808311 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b5f75457-e7a4-476b-a82c-4252e3f04a3d admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:52.894700 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b5f75457-e7a4-476b-a82c-4252e3f04a3d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:52.960562 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b5f75457-e7a4-476b-a82c-4252e3f04a3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:52.996357 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f75457-e7a4-476b-a82c-4252e3f04a3d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e0235bd4-2c2a-4141-b4c7-27c86c5047d7,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:53.000625 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-b5f75457-e7a4-476b-a82c-4252e3f04a3d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=d9da7c8a4a53430999f8ad000b94a21e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2041373 Aug 24 03:00:53.003760 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33526) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:53.049294 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-941489cb-6bf0-4289-bf8e-5ae4567e1451 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:53.069962 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-941489cb-6bf0-4289-bf8e-5ae4567e1451 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:53.177718 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ea8fe36-98d2-4632-ba89-b5666dd41c43 req-9a8140f3-2922-42d6-b95a-e2b3a7ef3bd3 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:53.179545 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5ea8fe36-98d2-4632-ba89-b5666dd41c43 req-9a8140f3-2922-42d6-b95a-e2b3a7ef3bd3 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0468454 Aug 24 03:00:53.202421 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-941489cb-6bf0-4289-bf8e-5ae4567e1451 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:53.204826 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-941489cb-6bf0-4289-bf8e-5ae4567e1451 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:53.205903 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-941489cb-6bf0-4289-bf8e-5ae4567e1451 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e0235bd4-2c2a-4141-b4c7-27c86c5047d7 HTTP/1.1" status: 204 len: 168 time: 0.2017608 Aug 24 03:00:53.220242 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-941489cb-6bf0-4289-bf8e-5ae4567e1451 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0235bd4-2c2a-4141-b4c7-27c86c5047d7,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:53.234123 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5ea8fe36-98d2-4632-ba89-b5666dd41c43 req-b6e171e3-b082-49ba-8b81-1c8fa200d5a7 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484250 Aug 24 03:00:53.347976 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3be8a8a3-72fa-4ae5-bf50-9cfe999c2c28 req-1f4fbbaf-fe8b-4b91-ba56-4ff3b0dc56d9 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:53.349433 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3be8a8a3-72fa-4ae5-bf50-9cfe999c2c28 req-1f4fbbaf-fe8b-4b91-ba56-4ff3b0dc56d9 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 949 time: 0.0537004 Aug 24 03:00:53.387068 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3be8a8a3-72fa-4ae5-bf50-9cfe999c2c28 req-7c6850d3-bf66-4352-97a9-503f7c7bc7dc tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309973 Aug 24 03:00:53.397561 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['3a1f9eaa-07bc-486c-afdd-ae491913e1ea'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:00:53.971856 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-ecf58291-ea9c-4d29-8f99-7a20ba5dcaf0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:54.337207 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:54.356322 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e68032a-3f31-4361-bf45-9a97f636234d req-13b42444-e547-4c5e-8699-3284f9dad522 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:54.357849 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8e68032a-3f31-4361-bf45-9a97f636234d req-13b42444-e547-4c5e-8699-3284f9dad522 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0493457 Aug 24 03:00:54.398481 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8e68032a-3f31-4361-bf45-9a97f636234d req-f648adba-c542-49da-8d7f-5009eb17c516 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344889 Aug 24 03:00:54.503660 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca986bba-073c-41d3-b668-19a3b17face5 req-c6b518a1-3b32-4877-bd57-dbcd37d9077e tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:54.505092 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ca986bba-073c-41d3-b668-19a3b17face5 req-c6b518a1-3b32-4877-bd57-dbcd37d9077e tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 949 time: 0.0502207 Aug 24 03:00:54.548720 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ca986bba-073c-41d3-b668-19a3b17face5 req-193997f8-e2ae-4454-ba5d-f11e7c4e493d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374160 Aug 24 03:00:55.073378 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 3a1f9eaa-07bc-486c-afdd-ae491913e1ea up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:00:55.189220 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:00:55.193178 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:00:55.194354 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:55.283322 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:55.305737 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd5af1509-b98e-44c3-b607-1518e6fa8577', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3a1f9eaa-07bc-486c-afdd-ae491913e1ea'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:00:55.307971 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f82ea2bd-d70c-4fdc-9131-7aa59e0887c8" -d '{"events": [{"server_uuid": "d5af1509-b98e-44c3-b607-1518e6fa8577", "name": "network-vif-plugged", "status": "completed", "tag": "3a1f9eaa-07bc-486c-afdd-ae491913e1ea"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:00:55.321021 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=3a1f9eaa-07bc-486c-afdd-ae491913e1ea,segment=NetworkSegment(497c966f-80df-41e8-af80-77eb55023bc6),segment_id=497c966f-80df-41e8-af80-77eb55023bc6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:00:55.345107 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:00:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3a19af1e-cbee-430e-a045-f336a9d2c75b x-openstack-request-id: req-3a19af1e-cbee-430e-a045-f336a9d2c75b {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:00:55.345414 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d5af1509-b98e-44c3-b607-1518e6fa8577", "name": "network-vif-plugged", "status": "completed", "tag": "3a1f9eaa-07bc-486c-afdd-ae491913e1ea", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:00:55.345692 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-3a19af1e-cbee-430e-a045-f336a9d2c75b {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:00:55.346075 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd5af1509-b98e-44c3-b607-1518e6fa8577', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3a1f9eaa-07bc-486c-afdd-ae491913e1ea', 'code': 200} Aug 24 03:00:55.406039 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:55.472773 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=3a1f9eaa-07bc-486c-afdd-ae491913e1ea,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:55.539462 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e72bef38-1259-4071-a297-5294268ba5a6 req-f38e64ab-8664-4ad5-a0b6-0e10e3852cb5 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:55.540942 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e72bef38-1259-4071-a297-5294268ba5a6 req-f38e64ab-8664-4ad5-a0b6-0e10e3852cb5 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0512354 Aug 24 03:00:55.572650 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:55.586136 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e72bef38-1259-4071-a297-5294268ba5a6 req-7c192064-a4dd-4206-ac14-d529273de21a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387642 Aug 24 03:00:55.701315 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d1d146b-14a8-40c7-843f-a322ae861121 req-c0268df5-81f9-4a93-ac6f-4321ad6235b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:55.703479 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d1d146b-14a8-40c7-843f-a322ae861121 req-c0268df5-81f9-4a93-ac6f-4321ad6235b9 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 1103 time: 0.0465922 Aug 24 03:00:55.713674 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f37afd6-ffb9-41cd-9fd1-5ff77bf76de5 req-bababd94-31c0-466c-b904-21f11f8f254f tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:55.715839 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2f37afd6-ffb9-41cd-9fd1-5ff77bf76de5 req-bababd94-31c0-466c-b904-21f11f8f254f tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 950 time: 0.0588284 Aug 24 03:00:55.727210 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33612) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:55.762134 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2f37afd6-ffb9-41cd-9fd1-5ff77bf76de5 req-74d784df-790a-4a12-aa04-f72c8ca40e67 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403440 Aug 24 03:00:55.762462 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d1d146b-14a8-40c7-843f-a322ae861121 req-b9cd972e-dad5-40ac-9d5b-c52be1450a1a service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512681 Aug 24 03:00:55.847374 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-df4b3b9b-6160-4428-a61a-c2ca516bee85 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:55.937000 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-df4b3b9b-6160-4428-a61a-c2ca516bee85 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:56.063695 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-df4b3b9b-6160-4428-a61a-c2ca516bee85 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:56.106446 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-df4b3b9b-6160-4428-a61a-c2ca516bee85 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=8b38bc1a13984e95bbbc79fcd9a31968&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3780761 Aug 24 03:00:56.108269 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df4b3b9b-6160-4428-a61a-c2ca516bee85 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a5a3a90-1abc-4420-bd97-f49c36ce35a1,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:56.108534 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33620) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:56.161128 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-c0d49b1a-27a3-4435-8b62-45e016bc7f3c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--97670715&fields=id&tenant_id=6b319ec439ef48f18d76e47df6300bc6 HTTP/1.1" status: 200 len: 267 time: 0.0337958 Aug 24 03:00:56.163894 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-904255d5-707c-49e9-b1c2-4d60fbad0ab1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:56.184766 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-904255d5-707c-49e9-b1c2-4d60fbad0ab1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:56.277317 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-70896b63-02f4-4932-8221-6210e6fc14a6 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:56.278926 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-70896b63-02f4-4932-8221-6210e6fc14a6 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/networks?id=72400947-ffa3-49a8-8805-03fdb89d0cfb HTTP/1.1" status: 200 len: 817 time: 0.1103151 Aug 24 03:00:56.294819 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-0cb4273f-f5f6-402b-af4c-a41fdf0f5f20 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/quotas/6b319ec439ef48f18d76e47df6300bc6 HTTP/1.1" status: 200 len: 375 time: 0.0097861 Aug 24 03:00:56.358678 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-0d729b6f-6a05-4039-bb91-39254fe7b565 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=6b319ec439ef48f18d76e47df6300bc6&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0576978 Aug 24 03:00:56.460555 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-10ef0b1e-2e70-4ddf-a2cc-43af2ed15769 service neutron] 10.222.0.30 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890350 Aug 24 03:00:56.502504 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-904255d5-707c-49e9-b1c2-4d60fbad0ab1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:56.505269 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-904255d5-707c-49e9-b1c2-4d60fbad0ab1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:56.507419 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-904255d5-707c-49e9-b1c2-4d60fbad0ab1 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/7a5a3a90-1abc-4420-bd97-f49c36ce35a1 HTTP/1.1" status: 204 len: 168 time: 0.3975310 Aug 24 03:00:56.514991 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-904255d5-707c-49e9-b1c2-4d60fbad0ab1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a5a3a90-1abc-4420-bd97-f49c36ce35a1,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:56.556657 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-f255d494-f8d8-4656-ab03-7ba9ea4038d5 service neutron] 10.222.0.30 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0899079 Aug 24 03:00:56.582935 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:00:56.874034 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e5ee2cb-b39b-4e52-b6b0-01a1c9f64ab0 req-1ed07972-4b13-4e06-a4ff-f2bb68005f41 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:56.875561 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4e5ee2cb-b39b-4e52-b6b0-01a1c9f64ab0 req-1ed07972-4b13-4e06-a4ff-f2bb68005f41 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0536406 Aug 24 03:00:56.921770 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4e5ee2cb-b39b-4e52-b6b0-01a1c9f64ab0 req-c82d0dfb-ec1b-43fe-ab16-fe8df0348f65 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0363071 Aug 24 03:00:56.965766 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:57.038272 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bce778d-9c60-4ffb-8d14-30369ebb4f94 req-7216864a-7dc9-4701-9860-65606c5f3356 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:57.039740 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3bce778d-9c60-4ffb-8d14-30369ebb4f94 req-7216864a-7dc9-4701-9860-65606c5f3356 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 950 time: 0.0581751 Aug 24 03:00:57.077608 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3bce778d-9c60-4ffb-8d14-30369ebb4f94 req-156758a0-fbd6-4981-9293-a1a1d8d5fd99 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315943 Aug 24 03:00:57.142848 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-76eb35b9-1bc8-4f74-b620-b24f20cdf52a req-f623fca0-e415-4136-9b10-a94e0cad837a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 210 time: 0.0279450 Aug 24 03:00:57.289093 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33646) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:57.302495 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-64c91f51-bf7f-4365-bb39-7941e078d882 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:57.392349 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-64c91f51-bf7f-4365-bb39-7941e078d882 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:57.451352 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-64c91f51-bf7f-4365-bb39-7941e078d882 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:57.488738 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-64c91f51-bf7f-4365-bb39-7941e078d882 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=70b5b14e7cb446329d7b3f2f01dcac70&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1985476 Aug 24 03:00:57.489562 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64c91f51-bf7f-4365-bb39-7941e078d882 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d82bd4bd-7c4e-4db5-8f17-7cab59b01f80,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:57.492389 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33648) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:00:57.543338 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a76c55bb-1dab-44c5-9256-3e7e1f80d15a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:57.565525 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a76c55bb-1dab-44c5-9256-3e7e1f80d15a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:57.685967 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a76c55bb-1dab-44c5-9256-3e7e1f80d15a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:57.688987 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a76c55bb-1dab-44c5-9256-3e7e1f80d15a admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:00:57.690175 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-a76c55bb-1dab-44c5-9256-3e7e1f80d15a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d82bd4bd-7c4e-4db5-8f17-7cab59b01f80 HTTP/1.1" status: 204 len: 168 time: 0.1966734 Aug 24 03:00:57.699891 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a76c55bb-1dab-44c5-9256-3e7e1f80d15a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d82bd4bd-7c4e-4db5-8f17-7cab59b01f80,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:00:58.042349 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ae356b-1b4a-4274-b6ed-aa4f0f99c316 req-dfc07300-7778-4e6b-968f-b6654d9fe9d6 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:58.044172 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-17ae356b-1b4a-4274-b6ed-aa4f0f99c316 req-dfc07300-7778-4e6b-968f-b6654d9fe9d6 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0523913 Aug 24 03:00:58.080979 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-17ae356b-1b4a-4274-b6ed-aa4f0f99c316 req-a70804a0-8cd9-4986-8af6-79bbd043b8b2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311179 Aug 24 03:00:58.196140 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f139a44-4495-4714-b1d9-5271a499cf6f req-e085199c-cc06-43b3-8dd5-5e0a8554ae4d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:58.197640 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7f139a44-4495-4714-b1d9-5271a499cf6f req-e085199c-cc06-43b3-8dd5-5e0a8554ae4d tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 950 time: 0.0491569 Aug 24 03:00:58.235448 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7f139a44-4495-4714-b1d9-5271a499cf6f req-12dde120-aa62-4830-ba32-e24f41ff7592 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318699 Aug 24 03:00:58.317078 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e2701305-2346-4963-8afa-7b4923ba2eda req-31e80e7e-50b7-4b53-a5c6-71849b51d401 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 210 time: 0.0282297 Aug 24 03:00:59.203838 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb47ae6-85ce-492b-99c5-825fdcea69b9 req-363fce81-7c08-4d7a-8b63-e8b9119d86ad tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:59.205474 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9eb47ae6-85ce-492b-99c5-825fdcea69b9 req-363fce81-7c08-4d7a-8b63-e8b9119d86ad tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0528748 Aug 24 03:00:59.243792 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9eb47ae6-85ce-492b-99c5-825fdcea69b9 req-1ae6cbb3-f47b-4d9c-8dcb-7fad0e2d476b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317402 Aug 24 03:00:59.353684 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd067101-4ada-4f49-8d9b-97538b822a54 req-854ee76b-c7df-478a-9b47-1717e2a9272f tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:00:59.355194 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-bd067101-4ada-4f49-8d9b-97538b822a54 req-854ee76b-c7df-478a-9b47-1717e2a9272f tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 950 time: 0.0488360 Aug 24 03:00:59.396555 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-bd067101-4ada-4f49-8d9b-97538b822a54 req-167f5e06-c374-450c-a883-6df362795b3e tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0349379 Aug 24 03:00:59.426492 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-48325b60-c21f-4a16-b25f-e0f05285c4e9 req-f4bc9e4e-3fba-45b5-aa6e-dbd1e8f1dcee tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 210 time: 0.0351844 Aug 24 03:01:00.366920 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-801c235b-ec94-49e1-8669-5cb660b6355f req-bb21f7ad-33b4-4574-9dd7-964144b486c3 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:00.367858 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-801c235b-ec94-49e1-8669-5cb660b6355f req-bb21f7ad-33b4-4574-9dd7-964144b486c3 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0504575 Aug 24 03:01:00.410102 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-801c235b-ec94-49e1-8669-5cb660b6355f req-709d06a5-d1a6-413a-8a79-a09b7b5e03e2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0356758 Aug 24 03:01:00.523739 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36968f66-9d1e-4e44-8b93-8e94f49838b4 req-5f91093a-ae9e-481d-a241-485b46e7c016 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:00.524371 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4280ab95-9ef1-49ec-be4b-e3e0594beaaf req-2f42bff4-910b-4eb2-9d29-669d9604777a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 210 time: 0.0270443 Aug 24 03:01:00.526052 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-36968f66-9d1e-4e44-8b93-8e94f49838b4 req-5f91093a-ae9e-481d-a241-485b46e7c016 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 950 time: 0.0565915 Aug 24 03:01:00.565423 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-36968f66-9d1e-4e44-8b93-8e94f49838b4 req-370863ca-d9b1-42c5-9032-052aaf92d450 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328484 Aug 24 03:01:00.848008 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33762) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:00.958975 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4c6738e7-8070-4d72-b051-54cb13834531 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:01.052441 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4c6738e7-8070-4d72-b051-54cb13834531 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:01.116098 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93569914-3d2e-446f-9689-aee018fba276 req-14c38dfe-db3e-4316-8c16-d9db250538a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:01.117967 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-93569914-3d2e-446f-9689-aee018fba276 req-14c38dfe-db3e-4316-8c16-d9db250538a0 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 1098 time: 0.0929863 Aug 24 03:01:01.139742 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-07a9bbd8-f6e1-4b3e-8ecf-6ced99c7e552 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:01.141128 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-07a9bbd8-f6e1-4b3e-8ecf-6ced99c7e552 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.43 "GET /v2.0/networks?id=72400947-ffa3-49a8-8805-03fdb89d0cfb HTTP/1.1" status: 200 len: 817 time: 0.1448715 Aug 24 03:01:01.183448 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4c6738e7-8070-4d72-b051-54cb13834531 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:01.185795 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-93569914-3d2e-446f-9689-aee018fba276 req-b4a33d56-797d-412a-9ce8-fdc30b5b856c service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436752 Aug 24 03:01:01.207451 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-3bbd3998-d3c3-4200-89b9-69a46630f71c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.43 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6b319ec439ef48f18d76e47df6300bc6 HTTP/1.1" status: 200 len: 378 time: 0.0435016 Aug 24 03:01:01.221003 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-4c6738e7-8070-4d72-b051-54cb13834531 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9afef9480c9e451dafb31b3d0ed3c68f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3716729 Aug 24 03:01:01.225757 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c6738e7-8070-4d72-b051-54cb13834531 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce32b393-885e-4c2e-a5e7-d8b7b61cc5e0,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:01.225877 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33770) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:01.274565 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-200d1531-0202-4703-adde-65f624197411 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:01.299083 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-200d1531-0202-4703-adde-65f624197411 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:01.430040 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-200d1531-0202-4703-adde-65f624197411 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:01.432741 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-200d1531-0202-4703-adde-65f624197411 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:01.434175 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-200d1531-0202-4703-adde-65f624197411 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ce32b393-885e-4c2e-a5e7-d8b7b61cc5e0 HTTP/1.1" status: 204 len: 168 time: 0.2076247 Aug 24 03:01:01.442332 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-200d1531-0202-4703-adde-65f624197411 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce32b393-885e-4c2e-a5e7-d8b7b61cc5e0,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:01.482250 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Request body: {'port': {'device_id': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'admin_state_up': True, 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'security_groups': ['a1448037-be52-4652-b9f5-5fdd1b21a769']}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:01:01.578685 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c078b7-890d-4e2c-a811-210bbe97ec26 req-5e273d68-d813-46ce-b6c9-db11e9129e3e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:01.580288 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-15c078b7-890d-4e2c-a811-210bbe97ec26 req-5e273d68-d813-46ce-b6c9-db11e9129e3e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0713482 Aug 24 03:01:01.625732 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-15c078b7-890d-4e2c-a811-210bbe97ec26 req-1086d8d6-81d6-45ff-86ae-5bce30a16b80 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389802 Aug 24 03:01:01.649522 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cc93e4a6-bd2a-4521-899f-3633a39b70a9 req-003e1349-b3ae-4f9d-9c0c-9e2ab648fe69 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 210 time: 0.0426853 Aug 24 03:01:01.714376 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Made reservation on behalf of 6b319ec439ef48f18d76e47df6300bc6 for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:01:01.718214 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:01.758844 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b75d56b1-0623-4763-803a-187ccc677894 req-f2b070c2-f787-4c98-b924-88dc9779b331 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:01.765173 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b75d56b1-0623-4763-803a-187ccc677894 req-f2b070c2-f787-4c98-b924-88dc9779b331 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 950 time: 0.0550191 Aug 24 03:01:01.798969 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b75d56b1-0623-4763-803a-187ccc677894 req-7f52de8a-0553-4004-83a1-610afef52a26 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313766 Aug 24 03:01:01.860614 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Allocated IP 172.20.0.10 (72400947-ffa3-49a8-8805-03fdb89d0cfb/465e9b83-ccde-4ea3-8e80-86590891b03c/881a8667-42c4-4263-84c5-a172725c834f) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:01:02.036649 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:02.059835 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Transition to ACTIVE for port object 881a8667-42c4-4263-84c5-a172725c834f will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:01:02.241719 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:02.284622 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Network 72400947-ffa3-49a8-8805-03fdb89d0cfb is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:01:02.288299 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:01:02.291891 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:01:02.322466 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event updated for resources: {'Port': ['ID=881a8667-42c4-4263-84c5-a172725c834f,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:02.353407 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:02.354076 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:02.477013 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33826) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:02.494552 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-550a2098-69b4-43ba-a195-c7759fc9a832 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:02.545794 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-86642976-16b2-41e0-975a-5f2978a4179c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0683203 Aug 24 03:01:02.579845 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Request body: {'port': {'device_id': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:01:02.628702 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-ac848ef9-1c66-4d33-a517-3310b538a7b7 None None] Provisioning for port 881a8667-42c4-4263-84c5-a172725c834f completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:01:02.632949 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-ac848ef9-1c66-4d33-a517-3310b538a7b7 None None] Provisioning complete for port 881a8667-42c4-4263-84c5-a172725c834f triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:01:02.633321 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-ac848ef9-1c66-4d33-a517-3310b538a7b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:02.668171 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-ac848ef9-1c66-4d33-a517-3310b538a7b7 None None] Port 881a8667-42c4-4263-84c5-a172725c834f cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:01:02.689561 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:02.709784 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5dcaab-a782-4818-bbef-7f2113df394f req-c5b092a8-a898-4faa-9031-14b16628b603 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:02.711476 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8e5dcaab-a782-4818-bbef-7f2113df394f req-c5b092a8-a898-4faa-9031-14b16628b603 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 950 time: 0.1077564 Aug 24 03:01:02.759094 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-550a2098-69b4-43ba-a195-c7759fc9a832 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:02.789167 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d13aed0-0705-45f3-bb0d-4ada4af3ad02 req-6743a55d-a1b0-4666-8c71-149189c201eb tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:02.790678 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9d13aed0-0705-45f3-bb0d-4ada4af3ad02 req-6743a55d-a1b0-4666-8c71-149189c201eb tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0564458 Aug 24 03:01:02.805881 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8e5dcaab-a782-4818-bbef-7f2113df394f req-cedbe0a3-7ad3-4a18-8a5f-bafc35b5f09f tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0840178 Aug 24 03:01:02.831261 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9d13aed0-0705-45f3-bb0d-4ada4af3ad02 req-4eeb6d67-2323-4c29-9676-bfe03e7a2dfe tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338116 Aug 24 03:01:02.850538 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-550a2098-69b4-43ba-a195-c7759fc9a832 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:02.916860 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-550a2098-69b4-43ba-a195-c7759fc9a832 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c3d306969d6b49c99505600ba89122be&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4387197 Aug 24 03:01:02.919649 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33836) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:02.928742 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-550a2098-69b4-43ba-a195-c7759fc9a832 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a79b043-b23f-4091-aa6a-a0e597da8ac2,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:02.979435 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-64371e07-445a-4010-9a11-e2f8aede5dab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:03.001492 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-64371e07-445a-4010-9a11-e2f8aede5dab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:03.014684 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15831cd2-0c25-4369-bd02-dc8f43689f9a req-4d7eeb97-3112-4b06-8cb8-eff902a1f69b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:03.016138 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-15831cd2-0c25-4369-bd02-dc8f43689f9a req-4d7eeb97-3112-4b06-8cb8-eff902a1f69b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 932 time: 0.1194587 Aug 24 03:01:03.081509 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-15831cd2-0c25-4369-bd02-dc8f43689f9a req-e309208a-e2d8-482d-8a7b-1fd9b797a739 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0562968 Aug 24 03:01:03.120407 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-64371e07-445a-4010-9a11-e2f8aede5dab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:03.120623 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 881a8667-42c4-4263-84c5-a172725c834f {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:01:03.122983 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-64371e07-445a-4010-9a11-e2f8aede5dab admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:03.124126 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-64371e07-445a-4010-9a11-e2f8aede5dab admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5a79b043-b23f-4091-aa6a-a0e597da8ac2 HTTP/1.1" status: 204 len: 168 time: 0.2035067 Aug 24 03:01:03.128383 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:03.134022 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64371e07-445a-4010-9a11-e2f8aede5dab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a79b043-b23f-4091-aa6a-a0e597da8ac2,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:03.140465 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Transition to ACTIVE for port object 881a8667-42c4-4263-84c5-a172725c834f will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:01:03.211212 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:03.260947 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Pushing event updated for resources: {'Port': ['ID=881a8667-42c4-4263-84c5-a172725c834f,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:03.330477 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Attempting to bind port 881a8667-42c4-4263-84c5-a172725c834f on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:01:03.330652 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Attempting to bind port 881a8667-42c4-4263-84c5-a172725c834f by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:01:03.330956 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Attempting to bind port 881a8667-42c4-4263-84c5-a172725c834f on network 72400947-ffa3-49a8-8805-03fdb89d0cfb {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:01:03.336647 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Port 881a8667-42c4-4263-84c5-a172725c834f on network 72400947-ffa3-49a8-8805-03fdb89d0cfb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:01:03.336971 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Attempting to bind port 881a8667-42c4-4263-84c5-a172725c834f on network 72400947-ffa3-49a8-8805-03fdb89d0cfb {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:01:03.342404 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 0, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:01:03.342741 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Checking segment: {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:01:03.343121 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Bound using segment: {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:01:03.343548 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Bound port: 881a8667-42c4-4263-84c5-a172725c834f, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:01:03.343900 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:03.432017 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:01:03.435849 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=881a8667-42c4-4263-84c5-a172725c834f,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:01:03.520933 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:03.556137 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:03.556758 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:03.558141 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] 10.222.0.43 "PUT /v2.0/ports/881a8667-42c4-4263-84c5-a172725c834f HTTP/1.1" status: 200 len: 1094 time: 0.9834120 Aug 24 03:01:03.558571 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'tag': '881a8667-42c4-4263-84c5-a172725c834f'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:01:03.560799 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1fc25588-cdb1-401b-bd1e-704b42d9f9d0" -d '{"events": [{"name": "network-changed", "server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "tag": "881a8667-42c4-4263-84c5-a172725c834f"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:01:03.596294 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e38b4b2-adf6-4879-8a26-e235f267a070 service neutron] Pushing event updated for resources: {'Port': ['ID=881a8667-42c4-4263-84c5-a172725c834f,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:03.621119 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:01:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d9a939a1-3e86-4de2-acdf-def8b1f53d11 x-openstack-request-id: req-d9a939a1-3e86-4de2-acdf-def8b1f53d11 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:01:03.621364 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "tag": "881a8667-42c4-4263-84c5-a172725c834f", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:01:03.621650 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-d9a939a1-3e86-4de2-acdf-def8b1f53d11 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:01:03.622120 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'tag': '881a8667-42c4-4263-84c5-a172725c834f', 'status': 'completed', 'code': 200} Aug 24 03:01:03.710929 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc25588-cdb1-401b-bd1e-704b42d9f9d0 req-929d2d84-e886-4391-9c52-9cab407a3da9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:03.712798 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1fc25588-cdb1-401b-bd1e-704b42d9f9d0 req-929d2d84-e886-4391-9c52-9cab407a3da9 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=6b319ec439ef48f18d76e47df6300bc6&device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 1097 time: 0.0536294 Aug 24 03:01:03.835716 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc25588-cdb1-401b-bd1e-704b42d9f9d0 req-ac078b93-9491-4da4-8a0d-e1180efcbc25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:03.837144 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1fc25588-cdb1-401b-bd1e-704b42d9f9d0 req-ac078b93-9491-4da4-8a0d-e1180efcbc25 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=6b319ec439ef48f18d76e47df6300bc6&shared=False HTTP/1.1" status: 200 len: 918 time: 0.1141984 Aug 24 03:01:03.938937 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88d8370a-e7ce-4a4e-8b2b-8e082190bf27 req-aa8baa76-017b-4264-a3ad-86ad7141572e tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:03.941585 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-88d8370a-e7ce-4a4e-8b2b-8e082190bf27 req-aa8baa76-017b-4264-a3ad-86ad7141572e tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 950 time: 0.0612288 Aug 24 03:01:03.975319 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc25588-cdb1-401b-bd1e-704b42d9f9d0 req-00461bfa-c927-4aaf-8e5d-46a41eba2eb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:03.976970 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1fc25588-cdb1-401b-bd1e-704b42d9f9d0 req-00461bfa-c927-4aaf-8e5d-46a41eba2eb7 service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1307969 Aug 24 03:01:03.982912 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-88d8370a-e7ce-4a4e-8b2b-8e082190bf27 req-3deca8c7-b6ce-482f-9060-b72cb2a33c37 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336001 Aug 24 03:01:03.999479 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68a08d9d-c50e-4132-a8d9-9d109b8b9482 req-5495a1c0-40f6-4728-bf55-48790bb0657b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:03.999479 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-68a08d9d-c50e-4132-a8d9-9d109b8b9482 req-5495a1c0-40f6-4728-bf55-48790bb0657b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0726395 Aug 24 03:01:04.211354 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee20417-2076-4ff8-b250-4e27808fe40a req-183f425f-7784-437d-bcd3-7d50240f1665 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:04.228271 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-bee20417-2076-4ff8-b250-4e27808fe40a req-183f425f-7784-437d-bcd3-7d50240f1665 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0723586 Aug 24 03:01:04.268863 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-bee20417-2076-4ff8-b250-4e27808fe40a req-c3409b72-d82c-4b5c-933b-ed1b85158e76 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0393724 Aug 24 03:01:04.302970 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-68a08d9d-c50e-4132-a8d9-9d109b8b9482 req-f7c42491-8e2c-4619-9d4a-0e3da7be4b0d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2941189 Aug 24 03:01:04.312257 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-a2959202-51c4-4d47-a82d-719b779f2e0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:04.315078 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-a2959202-51c4-4d47-a82d-719b779f2e0b service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=6b319ec439ef48f18d76e47df6300bc6&device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 1097 time: 0.0675623 Aug 24 03:01:04.361818 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-c030aad2-54eb-41ac-95d5-23b69e066bbd service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=881a8667-42c4-4263-84c5-a172725c834f HTTP/1.1" status: 200 len: 217 time: 0.0366733 Aug 24 03:01:04.417615 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-1fa73879-80d8-4bf5-82da-09de86feecb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:04.419082 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-1fa73879-80d8-4bf5-82da-09de86feecb9 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=465e9b83-ccde-4ea3-8e80-86590891b03c HTTP/1.1" status: 200 len: 856 time: 0.0497439 Aug 24 03:01:04.432260 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fdd6634-4945-4f01-b061-0dcae26d329e req-c0841636-6803-426d-ab7d-67e12392a35d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:04.433773 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6fdd6634-4945-4f01-b061-0dcae26d329e req-c0841636-6803-426d-ab7d-67e12392a35d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0541270 Aug 24 03:01:04.472840 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-6add95ab-24a6-4ce1-b073-a727ba4dbda7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:04.474343 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-6add95ab-24a6-4ce1-b073-a727ba4dbda7 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=72400947-ffa3-49a8-8805-03fdb89d0cfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0475941 Aug 24 03:01:04.475572 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6fdd6634-4945-4f01-b061-0dcae26d329e req-db40d369-2d45-428b-a3ad-3505e2c907a3 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340264 Aug 24 03:01:04.579349 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-759d1d55-f0d8-4a23-9c7c-bce5a2b93631 service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907602 Aug 24 03:01:04.684971 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4ca670bd-0756-41f1-868a-a59fcd18cf24 req-9d7f3d71-789d-4a2c-8f3c-1224fcf1956d service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0947099 Aug 24 03:01:05.120490 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-483521c1-2497-4796-8aed-6746d0d7cbb5 req-2193e7db-0d8e-4d6b-be7f-94e849e6566e tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:05.134803 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-483521c1-2497-4796-8aed-6746d0d7cbb5 req-2193e7db-0d8e-4d6b-be7f-94e849e6566e tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 950 time: 0.0764711 Aug 24 03:01:05.145319 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e0935a-73ec-40e6-b748-8bcd5b1c1d80 req-dd62e185-f329-44cd-95af-33f25c5279f5 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:05.147024 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a3e0935a-73ec-40e6-b748-8bcd5b1c1d80 req-dd62e185-f329-44cd-95af-33f25c5279f5 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.43 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 950 time: 0.0503905 Aug 24 03:01:05.179614 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-483521c1-2497-4796-8aed-6746d0d7cbb5 req-1227adbc-f122-4bea-b5fc-66f05542e92b tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/security-groups?id=95f0e636-77f1-49df-9524-df0f3645a779&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471654 Aug 24 03:01:05.180329 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33914) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:05.298311 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-a3e0935a-73ec-40e6-b748-8bcd5b1c1d80 req-8bc50221-3803-48d3-9f0a-65e2454f8975 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Deleting port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:01:05.298650 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-a3e0935a-73ec-40e6-b748-8bcd5b1c1d80 req-8bc50221-3803-48d3-9f0a-65e2454f8975 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:05.379080 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5074b486-cd59-4ca0-a778-86c5a7c3e0cc admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:05.452620 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-a3e0935a-73ec-40e6-b748-8bcd5b1c1d80 req-8bc50221-3803-48d3-9f0a-65e2454f8975 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] For port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=3a1f9eaa-07bc-486c-afdd-ae491913e1ea,segment=NetworkSegment(497c966f-80df-41e8-af80-77eb55023bc6),segment_id=497c966f-80df-41e8-af80-77eb55023bc6)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:01:05.453150 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-a3e0935a-73ec-40e6-b748-8bcd5b1c1d80 req-8bc50221-3803-48d3-9f0a-65e2454f8975 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:05.480254 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45831c5e-2721-4590-a207-90689b93829a req-d1a36a8a-6a10-4fd7-8c00-87c0e86ba700 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:05.481929 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-45831c5e-2721-4590-a207-90689b93829a req-d1a36a8a-6a10-4fd7-8c00-87c0e86ba700 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.1168852 Aug 24 03:01:05.488251 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-a3e0935a-73ec-40e6-b748-8bcd5b1c1d80 req-8bc50221-3803-48d3-9f0a-65e2454f8975 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Calling delete_port for 3a1f9eaa-07bc-486c-afdd-ae491913e1ea owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:01:05.529160 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5074b486-cd59-4ca0-a778-86c5a7c3e0cc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:05.564541 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-45831c5e-2721-4590-a207-90689b93829a req-ce6e1660-3c87-4b93-b1f3-03e429f26cb2 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0741966 Aug 24 03:01:05.600679 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5074b486-cd59-4ca0-a778-86c5a7c3e0cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:05.639368 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5074b486-cd59-4ca0-a778-86c5a7c3e0cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5af9ac2-c3f9-492a-99f0-e0912bff0432,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:05.648407 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-5074b486-cd59-4ca0-a778-86c5a7c3e0cc admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=706656e1c29c4ab683ea2e33ad8a6fc4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4667416 Aug 24 03:01:05.651113 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33930) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:05.711600 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3ea3bf6c-5bd4-4d0b-90e4-d0e599c75099 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:05.714807 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-a3e0935a-73ec-40e6-b748-8bcd5b1c1d80 req-8bc50221-3803-48d3-9f0a-65e2454f8975 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:05.729540 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['3a1f9eaa-07bc-486c-afdd-ae491913e1ea'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:01:05.738251 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3ea3bf6c-5bd4-4d0b-90e4-d0e599c75099 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:05.750689 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bc50221-3803-48d3-9f0a-65e2454f8975 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Pushing event deleted for resources: {'Port': ['ID=3a1f9eaa-07bc-486c-afdd-ae491913e1ea,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:05.798394 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-a3e0935a-73ec-40e6-b748-8bcd5b1c1d80 req-8bc50221-3803-48d3-9f0a-65e2454f8975 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] No DVR routers for this DVR port 3a1f9eaa-07bc-486c-afdd-ae491913e1ea on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:01:05.803867 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-a3e0935a-73ec-40e6-b748-8bcd5b1c1d80 req-8bc50221-3803-48d3-9f0a-65e2454f8975 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:05.806485 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a3e0935a-73ec-40e6-b748-8bcd5b1c1d80 req-8bc50221-3803-48d3-9f0a-65e2454f8975 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.43 "DELETE /v2.0/ports/3a1f9eaa-07bc-486c-afdd-ae491913e1ea HTTP/1.1" status: 204 len: 173 time: 0.6495352 Aug 24 03:01:05.806936 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd5af1509-b98e-44c3-b607-1518e6fa8577', 'name': 'network-vif-deleted', 'tag': '3a1f9eaa-07bc-486c-afdd-ae491913e1ea'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:01:05.811109 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0b47ae51-b4c9-4c4a-ae24-8c6e7a082003" -d '{"events": [{"server_uuid": "d5af1509-b98e-44c3-b607-1518e6fa8577", "name": "network-vif-deleted", "tag": "3a1f9eaa-07bc-486c-afdd-ae491913e1ea"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:01:05.849480 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:01:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c3c862cd-a4e3-43ce-b096-1421ba737609 x-openstack-request-id: req-c3c862cd-a4e3-43ce-b096-1421ba737609 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:01:05.850544 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d5af1509-b98e-44c3-b607-1518e6fa8577", "name": "network-vif-deleted", "tag": "3a1f9eaa-07bc-486c-afdd-ae491913e1ea", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:01:05.850746 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c3c862cd-a4e3-43ce-b096-1421ba737609 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:01:05.851145 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd5af1509-b98e-44c3-b607-1518e6fa8577', 'name': 'network-vif-deleted', 'tag': '3a1f9eaa-07bc-486c-afdd-ae491913e1ea', 'status': 'completed', 'code': 200} Aug 24 03:01:05.869262 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3ea3bf6c-5bd4-4d0b-90e4-d0e599c75099 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:05.872479 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3ea3bf6c-5bd4-4d0b-90e4-d0e599c75099 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:05.876436 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-3ea3bf6c-5bd4-4d0b-90e4-d0e599c75099 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/f5af9ac2-c3f9-492a-99f0-e0912bff0432 HTTP/1.1" status: 204 len: 168 time: 0.2214658 Aug 24 03:01:05.889485 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ea3bf6c-5bd4-4d0b-90e4-d0e599c75099 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5af9ac2-c3f9-492a-99f0-e0912bff0432,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:06.301063 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0b027c3f-d021-4898-8b47-8a284eb9a63a req-f131e791-8b69-423b-a27b-d2f196924d82 tempest-VolumesNegativeTest-1651390085 tempest-VolumesNegativeTest-1651390085-project] 10.222.0.30 "GET /v2.0/ports?device_id=d5af1509-b98e-44c3-b607-1518e6fa8577 HTTP/1.1" status: 200 len: 210 time: 0.0298939 Aug 24 03:01:06.642137 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 33962) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:06.663144 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2af692ea-2e39-4175-af99-9f246c7f0e2c admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:06.779205 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2af692ea-2e39-4175-af99-9f246c7f0e2c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:06.866091 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2af692ea-2e39-4175-af99-9f246c7f0e2c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:06.921187 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfb9f893-b7e7-4e6b-b31e-58ed6e5e1aba req-d580f87c-fdae-4120-ad4f-f07ef024b81f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:06.921187 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bfb9f893-b7e7-4e6b-b31e-58ed6e5e1aba req-d580f87c-fdae-4120-ad4f-f07ef024b81f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.1091149 Aug 24 03:01:06.945528 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-2af692ea-2e39-4175-af99-9f246c7f0e2c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=77cae64fbb22490a85e20dc967c4c7be&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3019137 Aug 24 03:01:06.948395 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 33970) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:06.951499 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2af692ea-2e39-4175-af99-9f246c7f0e2c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60962c34-d6dd-4e73-bdc7-e9e297226080,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:06.990746 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b7ef6fb-1fd8-4fbe-a5e0-bb9ec41ff787 req-8cefbd08-6815-4945-a027-e9b64bb15ffa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:06.992250 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0b7ef6fb-1fd8-4fbe-a5e0-bb9ec41ff787 req-8cefbd08-6815-4945-a027-e9b64bb15ffa service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 1098 time: 0.1084785 Aug 24 03:01:06.995659 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bfb9f893-b7e7-4e6b-b31e-58ed6e5e1aba req-d739cf2d-594c-41ee-9697-f464c65e857b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0565808 Aug 24 03:01:07.012266 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dc030672-0201-49f6-aafe-04bd9afd9bd0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:07.034864 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dc030672-0201-49f6-aafe-04bd9afd9bd0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:07.123245 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b7ef6fb-1fd8-4fbe-a5e0-bb9ec41ff787 req-44b645f8-9370-415d-9405-1136646a7958 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:07.124727 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0b7ef6fb-1fd8-4fbe-a5e0-bb9ec41ff787 req-44b645f8-9370-415d-9405-1136646a7958 service neutron] 10.222.0.43 "GET /v2.0/networks?id=4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 200 len: 919 time: 0.1234689 Aug 24 03:01:07.148056 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4517180a-4eac-4939-95eb-398fceda362d req-55046a1d-272f-4cb7-8742-00df96bd5046 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:07.149647 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4517180a-4eac-4939-95eb-398fceda362d req-55046a1d-272f-4cb7-8742-00df96bd5046 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0708294 Aug 24 03:01:07.149848 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 881a8667-42c4-4263-84c5-a172725c834f details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:01:07.179029 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0b7ef6fb-1fd8-4fbe-a5e0-bb9ec41ff787 req-037a427a-ab44-44fe-8caf-1145cc32ab5c service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=706be5c2-c6fb-496a-ac91-104e4cc11ae7 HTTP/1.1" status: 200 len: 217 time: 0.0469587 Aug 24 03:01:07.238751 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4517180a-4eac-4939-95eb-398fceda362d req-a3995cd7-59a2-4e66-89b5-d0c5195c2377 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621765 Aug 24 03:01:07.250110 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=881a8667-42c4-4263-84c5-a172725c834f,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:01:07.262856 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '881a8667-42c4-4263-84c5-a172725c834f', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'port_id': '881a8667-42c4-4263-84c5-a172725c834f', 'mac_address': 'fa:16:3e:85:26:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:01:07.263070 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b7ef6fb-1fd8-4fbe-a5e0-bb9ec41ff787 req-5ec3f607-62c8-48d3-89c1-c92b94b64e7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:07.264654 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0b7ef6fb-1fd8-4fbe-a5e0-bb9ec41ff787 req-5ec3f607-62c8-48d3-89c1-c92b94b64e7d service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4f536c4e-b790-4630-bdc6-867501285c32 HTTP/1.1" status: 200 len: 858 time: 0.0661383 Aug 24 03:01:07.274531 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dc030672-0201-49f6-aafe-04bd9afd9bd0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:07.277193 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dc030672-0201-49f6-aafe-04bd9afd9bd0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:07.279649 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-dc030672-0201-49f6-aafe-04bd9afd9bd0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/60962c34-d6dd-4e73-bdc7-e9e297226080 HTTP/1.1" status: 204 len: 168 time: 0.3288169 Aug 24 03:01:07.289383 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc030672-0201-49f6-aafe-04bd9afd9bd0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60962c34-d6dd-4e73-bdc7-e9e297226080,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:07.315067 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0b7ef6fb-1fd8-4fbe-a5e0-bb9ec41ff787 req-a33af3ee-6cb7-4897-87d9-9d6df8ee85a7 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=4091852f-86f8-4dac-87af-44624502a74d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0318077 Aug 24 03:01:07.318143 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:07.340847 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 881a8667-42c4-4263-84c5-a172725c834f {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:01:07.365757 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=881a8667-42c4-4263-84c5-a172725c834f,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:01:07.437913 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0b7ef6fb-1fd8-4fbe-a5e0-bb9ec41ff787 req-6bdb8c8c-62b3-42a7-8dec-016631c18f09 service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1140418 Aug 24 03:01:07.545027 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:07.550958 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0b7ef6fb-1fd8-4fbe-a5e0-bb9ec41ff787 req-f2610e28-b2dc-4bd3-a8c7-33d01a31f82d service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0988019 Aug 24 03:01:07.671405 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=881a8667-42c4-4263-84c5-a172725c834f,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:07.754669 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:07.900233 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['881a8667-42c4-4263-84c5-a172725c834f'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:01:08.137638 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d44a89a5-a9f9-4232-85cc-8ae64b994876 req-947f77ce-089e-42f0-8124-298d6618aeab tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:08.139133 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d44a89a5-a9f9-4232-85cc-8ae64b994876 req-947f77ce-089e-42f0-8124-298d6618aeab tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 945 time: 0.0507247 Aug 24 03:01:08.182674 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d44a89a5-a9f9-4232-85cc-8ae64b994876 req-571ed4c6-ef2f-4c24-8f60-dbdb8a15dd93 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0372968 Aug 24 03:01:08.388576 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d271fd3b-7353-489e-8748-ed6105d297dd req-8dc18121-8824-4961-b747-71de983c3c64 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:08.390649 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d271fd3b-7353-489e-8748-ed6105d297dd req-8dc18121-8824-4961-b747-71de983c3c64 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0556440 Aug 24 03:01:08.446979 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d271fd3b-7353-489e-8748-ed6105d297dd req-a77ee2c0-d3a7-4fe0-b789-07b6862667b7 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462713 Aug 24 03:01:09.170360 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 881a8667-42c4-4263-84c5-a172725c834f up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:01:09.304912 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-999e181e-7ca8-42a4-ac2a-8e042a4e8946 req-738cb925-ca8e-422a-b470-890e64f32ffc tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:09.306392 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-999e181e-7ca8-42a4-ac2a-8e042a4e8946 req-738cb925-ca8e-422a-b470-890e64f32ffc tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 945 time: 0.0508039 Aug 24 03:01:09.344404 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 881a8667-42c4-4263-84c5-a172725c834f completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:01:09.351506 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 881a8667-42c4-4263-84c5-a172725c834f triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:01:09.351506 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:09.351723 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-999e181e-7ca8-42a4-ac2a-8e042a4e8946 req-7845721d-de93-4b3d-a7de-df76f4b738db tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0385578 Aug 24 03:01:09.443085 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:09.470040 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '881a8667-42c4-4263-84c5-a172725c834f'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:01:09.472505 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-befd90f3-7137-4a2a-bc9d-f619d0e9f293" -d '{"events": [{"server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "name": "network-vif-plugged", "status": "completed", "tag": "881a8667-42c4-4263-84c5-a172725c834f"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:01:09.488002 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=881a8667-42c4-4263-84c5-a172725c834f,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:01:09.520157 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:01:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e28000b7-7b78-455a-bfcb-1413eeaa15f4 x-openstack-request-id: req-e28000b7-7b78-455a-bfcb-1413eeaa15f4 {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:01:09.520487 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "name": "network-vif-plugged", "status": "completed", "tag": "881a8667-42c4-4263-84c5-a172725c834f", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:01:09.520744 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e28000b7-7b78-455a-bfcb-1413eeaa15f4 {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:01:09.521142 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '881a8667-42c4-4263-84c5-a172725c834f', 'code': 200} Aug 24 03:01:09.538421 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:09.539344 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 3a1f9eaa-07bc-486c-afdd-ae491913e1ea no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:01:09.572126 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 3a1f9eaa-07bc-486c-afdd-ae491913e1ea {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:01:09.574725 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 3a1f9eaa-07bc-486c-afdd-ae491913e1ea not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:01:09.633184 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=881a8667-42c4-4263-84c5-a172725c834f,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:09.658299 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc9b469-bd99-4223-ac39-0b65e5f42c80 req-7b9c4b1a-1abd-47a3-9335-b74a6b2413e0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:09.658299 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5cc9b469-bd99-4223-ac39-0b65e5f42c80 req-7b9c4b1a-1abd-47a3-9335-b74a6b2413e0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.1159382 Aug 24 03:01:09.746095 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5cc9b469-bd99-4223-ac39-0b65e5f42c80 req-fa77f6bc-ba62-47d0-a00e-05ea9857dc1a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0841041 Aug 24 03:01:09.868753 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-379d2213-7684-44ff-bea4-723820a50c44 req-63afccdd-6731-47e8-9f82-9b26986d4745 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:09.870318 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-379d2213-7684-44ff-bea4-723820a50c44 req-63afccdd-6731-47e8-9f82-9b26986d4745 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 1099 time: 0.0486457 Aug 24 03:01:09.912776 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-379d2213-7684-44ff-bea4-723820a50c44 req-07099423-1bbe-415a-a4c1-831576ae6c01 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0333433 Aug 24 03:01:10.478683 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d757c97-57f9-4f74-be2c-2a2549475276 req-b33fc812-3fc0-4edf-a207-d40fd1e69596 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:10.480148 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0d757c97-57f9-4f74-be2c-2a2549475276 req-b33fc812-3fc0-4edf-a207-d40fd1e69596 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0484023 Aug 24 03:01:10.517481 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0d757c97-57f9-4f74-be2c-2a2549475276 req-f2897949-eed4-4d8d-8321-3d2b43728d2b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0310552 Aug 24 03:01:10.951321 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe2dbef0-c1c4-4324-be04-cb4818e2713b req-9ed40b84-b27c-4512-a3ad-3fb59e226c3d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:10.952944 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fe2dbef0-c1c4-4324-be04-cb4818e2713b req-9ed40b84-b27c-4512-a3ad-3fb59e226c3d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0605133 Aug 24 03:01:10.996054 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fe2dbef0-c1c4-4324-be04-cb4818e2713b req-1428403f-fa6b-4e4a-a514-ac3630ad707c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328693 Aug 24 03:01:11.640580 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85aa6694-f95b-40fc-9acc-0c199b92e43f req-17c11055-370e-4d97-ba0f-0c18ddd2c254 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:11.642106 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-85aa6694-f95b-40fc-9acc-0c199b92e43f req-17c11055-370e-4d97-ba0f-0c18ddd2c254 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0484250 Aug 24 03:01:11.680202 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-85aa6694-f95b-40fc-9acc-0c199b92e43f req-5b48b78c-e779-48d4-85c7-d374a7593dbd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0315356 Aug 24 03:01:12.131319 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a62da928-5530-4d0e-9b75-42abc3861a19 req-df8c108f-9049-42c0-8a80-4a62d6bf47ca tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:12.133198 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a62da928-5530-4d0e-9b75-42abc3861a19 req-df8c108f-9049-42c0-8a80-4a62d6bf47ca tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0592356 Aug 24 03:01:12.183914 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a62da928-5530-4d0e-9b75-42abc3861a19 req-871afee0-9de9-465d-b63d-f97694718d3b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443728 Aug 24 03:01:12.803910 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-409baa51-c199-48fc-999b-a68dd60d0b38 req-13ae770a-386e-4a27-bd96-19572f7779ff tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:12.807062 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-409baa51-c199-48fc-999b-a68dd60d0b38 req-13ae770a-386e-4a27-bd96-19572f7779ff tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0528634 Aug 24 03:01:12.844716 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-409baa51-c199-48fc-999b-a68dd60d0b38 req-202a11f3-18e0-4808-9a68-e45700d677f9 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0327752 Aug 24 03:01:13.304475 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0e507a-50d7-47a4-9892-0117f51f4727 req-0832c74f-a8bf-4ef9-827e-7645f5e15b7d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:13.306068 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bd0e507a-50d7-47a4-9892-0117f51f4727 req-0832c74f-a8bf-4ef9-827e-7645f5e15b7d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0481176 Aug 24 03:01:13.344084 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bd0e507a-50d7-47a4-9892-0117f51f4727 req-a2e725e0-d222-4689-8d0e-aeb9a9f2fd98 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321341 Aug 24 03:01:13.963238 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2856bc-b87a-4f01-b31e-6980017f87b8 req-e802de4b-84cd-4029-9f2e-1e0e2f045a53 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:13.964630 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-be2856bc-b87a-4f01-b31e-6980017f87b8 req-e802de4b-84cd-4029-9f2e-1e0e2f045a53 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0486717 Aug 24 03:01:14.002644 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-be2856bc-b87a-4f01-b31e-6980017f87b8 req-587b8e96-7913-4729-a348-cf95b71c72e6 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0319664 Aug 24 03:01:14.458045 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91919af2-55f3-40d4-a041-840521634fc4 req-8673d5d7-a6cf-4361-96e0-7b8075e34d5a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:14.460176 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-91919af2-55f3-40d4-a041-840521634fc4 req-8673d5d7-a6cf-4361-96e0-7b8075e34d5a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0490234 Aug 24 03:01:14.499429 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-91919af2-55f3-40d4-a041-840521634fc4 req-347661e3-9940-4ce4-a132-a7658ecdf839 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329645 Aug 24 03:01:15.118726 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd6c7dfc-df0c-4c5d-8126-e41560b0174c req-42111e84-edc6-4b2e-9c1e-fa49510e280d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:15.120184 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-dd6c7dfc-df0c-4c5d-8126-e41560b0174c req-42111e84-edc6-4b2e-9c1e-fa49510e280d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0474398 Aug 24 03:01:15.160002 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-dd6c7dfc-df0c-4c5d-8126-e41560b0174c req-9cf31949-f339-4ad4-89eb-bc448dbaf471 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0325189 Aug 24 03:01:15.285558 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f8a7a49-5f80-401c-b027-8cf283c93233 req-b3ef99be-f241-45cc-927b-aa0ba0c61885 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:15.287138 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4f8a7a49-5f80-401c-b027-8cf283c93233 req-b3ef99be-f241-45cc-927b-aa0ba0c61885 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0535522 Aug 24 03:01:15.295804 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 34424) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:15.304204 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-0a675e06-58b6-47d9-a1b8-584f93254b41 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Request body: {'floatingip': {'port_id': '881a8667-42c4-4263-84c5-a172725c834f'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:01:15.395127 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0a675e06-58b6-47d9-a1b8-584f93254b41 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:15.628393 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1fc0d54-43d2-4cb6-b35b-6f5c9c291ef1 req-521aad0d-850c-4826-81a0-7041a1bfa204 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:15.630085 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b1fc0d54-43d2-4cb6-b35b-6f5c9c291ef1 req-521aad0d-850c-4826-81a0-7041a1bfa204 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0604393 Aug 24 03:01:15.671559 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b1fc0d54-43d2-4cb6-b35b-6f5c9c291ef1 req-c4f1d0b0-2c98-44fa-bb13-2aba622ecffb tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330164 Aug 24 03:01:15.855252 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 34454) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:15.989447 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4f3f469b-6e3a-4e32-9db5-6884a6e0c1d9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:16.093701 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4f3f469b-6e3a-4e32-9db5-6884a6e0c1d9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:16.147981 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0a675e06-58b6-47d9-a1b8-584f93254b41 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:16.182870 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4f3f469b-6e3a-4e32-9db5-6884a6e0c1d9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:16.231504 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-4f3f469b-6e3a-4e32-9db5-6884a6e0c1d9 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=698eecec07fb4393b9c9edc705b61311&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3751543 Aug 24 03:01:16.234211 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 34462) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:16.235439 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f3f469b-6e3a-4e32-9db5-6884a6e0c1d9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a30be31-4c29-42dc-a4a3-1c02c663a4e9,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:16.242833 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0a675e06-58b6-47d9-a1b8-584f93254b41 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:16.364967 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f4b7f5b1-c6be-47be-a144-d9e9992c6eb8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:16.398818 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f4b7f5b1-c6be-47be-a144-d9e9992c6eb8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:16.401013 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.l3_db [None req-0a675e06-58b6-47d9-a1b8-584f93254b41 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Floating IP ebbc0a41-08cf-4f3e-b20a-e2e59171ca53 associated. External IP: 172.27.2.83, port: 881a8667-42c4-4263-84c5-a172725c834f. Aug 24 03:01:16.482425 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 34470) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:16.793987 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4f83329-60ba-480a-845b-6d75b7ca86de req-7ab2975f-2673-46b5-a99b-a4d9799623c8 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:16.795498 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d4f83329-60ba-480a-845b-6d75b7ca86de req-7ab2975f-2673-46b5-a99b-a4d9799623c8 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0504503 Aug 24 03:01:16.808978 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f4b7f5b1-c6be-47be-a144-d9e9992c6eb8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:16.811795 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f4b7f5b1-c6be-47be-a144-d9e9992c6eb8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:16.813134 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-f4b7f5b1-c6be-47be-a144-d9e9992c6eb8 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/9a30be31-4c29-42dc-a4a3-1c02c663a4e9 HTTP/1.1" status: 204 len: 168 time: 0.5779207 Aug 24 03:01:16.837133 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b7f5b1-c6be-47be-a144-d9e9992c6eb8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a30be31-4c29-42dc-a4a3-1c02c663a4e9,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:16.852375 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d4f83329-60ba-480a-845b-6d75b7ca86de req-b8f5d8d4-e46a-462c-8855-383cd7f55b27 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422890 Aug 24 03:01:16.901869 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-e18715aa-9589-46e0-8478-a478945a6dae admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=1ac6ae42d3d3478aab4103c3629db149&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4182105 Aug 24 03:01:16.904608 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 34482) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:16.924685 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a675e06-58b6-47d9-a1b8-584f93254b41 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Router 0195ba54-f802-48e9-b0df-bdb173e4aa57 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:01:16.961728 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-461b6e72-60c5-427f-a5df-8db42d71b6e1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:16.988360 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-461b6e72-60c5-427f-a5df-8db42d71b6e1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:17.050223 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a675e06-58b6-47d9-a1b8-584f93254b41 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:01:17.057774 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0a675e06-58b6-47d9-a1b8-584f93254b41 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:17.062567 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6d0a4d7-e0a2-4454-b844-3fbf8fee1f07 None None] Sync routers for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:01:17.075094 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6d0a4d7-e0a2-4454-b844-3fbf8fee1f07 None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:01:17.075917 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-a6d0a4d7-e0a2-4454-b844-3fbf8fee1f07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:00:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:01:17.087406 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-0a675e06-58b6-47d9-a1b8-584f93254b41 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "PUT /v2.0/floatingips/ebbc0a41-08cf-4f3e-b20a-e2e59171ca53 HTTP/1.1" status: 200 len: 991 time: 1.7905157 Aug 24 03:01:17.088242 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'tag': '881a8667-42c4-4263-84c5-a172725c834f'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:01:17.091031 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b120ef4-984f-4708-a7d3-642ee330bbec" -d '{"events": [{"name": "network-changed", "server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "tag": "881a8667-42c4-4263-84c5-a172725c834f"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:01:17.154226 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:01:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ebbb19cc-383d-4a1f-9f81-63277e1194cf x-openstack-request-id: req-ebbb19cc-383d-4a1f-9f81-63277e1194cf {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:01:17.154226 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "tag": "881a8667-42c4-4263-84c5-a172725c834f", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:01:17.154226 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-ebbb19cc-383d-4a1f-9f81-63277e1194cf {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:01:17.154226 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'tag': '881a8667-42c4-4263-84c5-a172725c834f', 'status': 'completed', 'code': 200} Aug 24 03:01:17.177037 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-461b6e72-60c5-427f-a5df-8db42d71b6e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:17.180524 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-461b6e72-60c5-427f-a5df-8db42d71b6e1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:17.185001 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-461b6e72-60c5-427f-a5df-8db42d71b6e1 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/95f0e636-77f1-49df-9524-df0f3645a779 HTTP/1.1" status: 204 len: 168 time: 0.2792115 Aug 24 03:01:17.195567 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-461b6e72-60c5-427f-a5df-8db42d71b6e1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95f0e636-77f1-49df-9524-df0f3645a779,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:17.250802 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b120ef4-984f-4708-a7d3-642ee330bbec req-f12ac5d1-4d8d-4be2-9dd0-3141fc65b839 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:17.252375 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b120ef4-984f-4708-a7d3-642ee330bbec req-f12ac5d1-4d8d-4be2-9dd0-3141fc65b839 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=6b319ec439ef48f18d76e47df6300bc6&device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 1099 time: 0.0673859 Aug 24 03:01:17.343288 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-a6d0a4d7-e0a2-4454-b844-3fbf8fee1f07 None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:01:17.369705 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b120ef4-984f-4708-a7d3-642ee330bbec req-fb23007d-7497-47ca-9135-2e1afe0642f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:17.371235 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b120ef4-984f-4708-a7d3-642ee330bbec req-fb23007d-7497-47ca-9135-2e1afe0642f1 service neutron] 10.222.0.43 "GET /v2.0/networks?id=72400947-ffa3-49a8-8805-03fdb89d0cfb HTTP/1.1" status: 200 len: 918 time: 0.1113992 Aug 24 03:01:17.474105 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b120ef4-984f-4708-a7d3-642ee330bbec req-07a3a330-23c4-415a-a704-387d3ac4b7b4 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=881a8667-42c4-4263-84c5-a172725c834f HTTP/1.1" status: 200 len: 999 time: 0.0810432 Aug 24 03:01:17.532749 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b120ef4-984f-4708-a7d3-642ee330bbec req-b532f306-5eb3-4d75-9437-249cf967c944 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:17.534321 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b120ef4-984f-4708-a7d3-642ee330bbec req-b532f306-5eb3-4d75-9437-249cf967c944 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=465e9b83-ccde-4ea3-8e80-86590891b03c HTTP/1.1" status: 200 len: 856 time: 0.0457873 Aug 24 03:01:17.597219 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-a6d0a4d7-e0a2-4454-b844-3fbf8fee1f07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'ebbc0a41-08cf-4f3e-b20a-e2e59171ca53', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'floating_ip_address': '172.27.2.83', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'port_id': '881a8667-42c4-4263-84c5-a172725c834f', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 252, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'mac_address': 'fa:16:3e:85:26:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:00:47Z', 'updated_at': '2021-08-24T03:01:15Z', 'revision_number': 1, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:49Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:01:17.597527 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b120ef4-984f-4708-a7d3-642ee330bbec req-1342211e-bff2-43b9-b795-8060ff1adaaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:17.599101 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b120ef4-984f-4708-a7d3-642ee330bbec req-1342211e-bff2-43b9-b795-8060ff1adaaa service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=72400947-ffa3-49a8-8805-03fdb89d0cfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0498924 Aug 24 03:01:17.626139 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6d0a4d7-e0a2-4454-b844-3fbf8fee1f07 None None] Checking router: 0195ba54-f802-48e9-b0df-bdb173e4aa57 for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:01:17.635412 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6d0a4d7-e0a2-4454-b844-3fbf8fee1f07 None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:01:17.636112 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-a6d0a4d7-e0a2-4454-b844-3fbf8fee1f07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:00:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:01:17.685652 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 34516) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:17.699531 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8ae15501-d000-4c8f-a29a-7afcd2c1c991 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:17.707031 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b120ef4-984f-4708-a7d3-642ee330bbec req-e099b34c-a484-4b8d-a033-f3f88caf5142 service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0924573 Aug 24 03:01:17.760652 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-a6d0a4d7-e0a2-4454-b844-3fbf8fee1f07 None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:01:17.804858 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8ae15501-d000-4c8f-a29a-7afcd2c1c991 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:17.838055 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b120ef4-984f-4708-a7d3-642ee330bbec req-bf0f4d30-635f-458e-9efa-e93e17b88aad service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1220489 Aug 24 03:01:17.879895 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8ae15501-d000-4c8f-a29a-7afcd2c1c991 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:17.914500 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-8ae15501-d000-4c8f-a29a-7afcd2c1c991 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ada1ab84b5be4333a4a65f70f26b612a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2277327 Aug 24 03:01:17.919321 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 34524) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:17.935608 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ae15501-d000-4c8f-a29a-7afcd2c1c991 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25b45f50-65f3-4638-a0bb-2f797ca2071b,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:17.968557 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed062f3f-b21e-4775-9360-92e9b9b8cb34 req-1ee88b73-1ec2-44c2-a1bf-21f863cce433 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:17.970171 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ed062f3f-b21e-4775-9360-92e9b9b8cb34 req-1ee88b73-1ec2-44c2-a1bf-21f863cce433 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0567992 Aug 24 03:01:17.998148 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-abb9b404-5628-49b2-8b15-a7b7c6de5310 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:18.022813 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-abb9b404-5628-49b2-8b15-a7b7c6de5310 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:18.024197 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ed062f3f-b21e-4775-9360-92e9b9b8cb34 req-f0eeeead-3143-4ae1-b30e-2b25233e5472 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447390 Aug 24 03:01:18.028019 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-a6d0a4d7-e0a2-4454-b844-3fbf8fee1f07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'ebbc0a41-08cf-4f3e-b20a-e2e59171ca53', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'floating_ip_address': '172.27.2.83', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'port_id': '881a8667-42c4-4263-84c5-a172725c834f', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 252, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'mac_address': 'fa:16:3e:85:26:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:00:47Z', 'updated_at': '2021-08-24T03:01:15Z', 'revision_number': 1, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:49Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:01:18.062678 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6d0a4d7-e0a2-4454-b844-3fbf8fee1f07 None None] The sync data for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi is: [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'ebbc0a41-08cf-4f3e-b20a-e2e59171ca53', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'floating_ip_address': '172.27.2.83', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'port_id': '881a8667-42c4-4263-84c5-a172725c834f', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 252, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'mac_address': 'fa:16:3e:85:26:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:00:47Z', 'updated_at': '2021-08-24T03:01:15Z', 'revision_number': 1, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:49Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:01:18.200219 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-abb9b404-5628-49b2-8b15-a7b7c6de5310 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:18.202860 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-abb9b404-5628-49b2-8b15-a7b7c6de5310 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:18.206287 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-abb9b404-5628-49b2-8b15-a7b7c6de5310 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/25b45f50-65f3-4638-a0bb-2f797ca2071b HTTP/1.1" status: 204 len: 168 time: 0.2836180 Aug 24 03:01:18.213181 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abb9b404-5628-49b2-8b15-a7b7c6de5310 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25b45f50-65f3-4638-a0bb-2f797ca2071b,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:18.260217 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-198b22cc-63f4-4c4a-99c5-407cb2b3d911 None None] New status for floating IP ebbc0a41-08cf-4f3e-b20a-e2e59171ca53: ACTIVE {{(pid=111277) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:01:20.789195 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afa77a59-386b-42a2-b76c-f22fe197b745 req-e851190d-d9a1-4280-baf2-aeb6fe8fee05 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:20.790728 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-afa77a59-386b-42a2-b76c-f22fe197b745 req-e851190d-d9a1-4280-baf2-aeb6fe8fee05 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0484290 Aug 24 03:01:20.829023 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-afa77a59-386b-42a2-b76c-f22fe197b745 req-3ffe352d-26ab-427b-ba1c-ffa98b56f6c7 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322316 Aug 24 03:01:21.132929 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 34644) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:21.237977 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-574236e0-fa25-42be-bc7f-ad1d89ad49f3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:21.326709 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-574236e0-fa25-42be-bc7f-ad1d89ad49f3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:21.393733 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-574236e0-fa25-42be-bc7f-ad1d89ad49f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:21.393898 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-1954d061-14ab-4df2-b6cb-ff025265ffef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:21.432668 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-574236e0-fa25-42be-bc7f-ad1d89ad49f3 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=97189504873a42668f3a5d2f37451a45&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2985504 Aug 24 03:01:21.433832 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-574236e0-fa25-42be-bc7f-ad1d89ad49f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e92e63cf-0529-4205-bbc6-8eef01e924f0,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:21.435275 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 34654) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:21.488914 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-141d2d49-3575-40bc-81f7-542fcfc945d6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:21.518102 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-141d2d49-3575-40bc-81f7-542fcfc945d6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:21.702666 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-141d2d49-3575-40bc-81f7-542fcfc945d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:21.705426 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-141d2d49-3575-40bc-81f7-542fcfc945d6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:21.706729 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-141d2d49-3575-40bc-81f7-542fcfc945d6 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e92e63cf-0529-4205-bbc6-8eef01e924f0 HTTP/1.1" status: 204 len: 168 time: 0.2704692 Aug 24 03:01:21.716854 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-141d2d49-3575-40bc-81f7-542fcfc945d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e92e63cf-0529-4205-bbc6-8eef01e924f0,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:21.953967 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b1242ba-6262-421f-bfe5-ecc66a822e56 req-690d1ea5-af63-4e91-9b9e-f5b333aeb85c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:21.955452 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0b1242ba-6262-421f-bfe5-ecc66a822e56 req-690d1ea5-af63-4e91-9b9e-f5b333aeb85c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0535409 Aug 24 03:01:21.993404 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0b1242ba-6262-421f-bfe5-ecc66a822e56 req-02f2a845-f017-418a-98dc-2fb7eb12834e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315189 Aug 24 03:01:22.440871 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 34678) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:22.453857 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-758febd0-613c-432e-8961-8eeba2aec3a2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:22.540535 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-758febd0-613c-432e-8961-8eeba2aec3a2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:22.616870 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-758febd0-613c-432e-8961-8eeba2aec3a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:22.653559 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-758febd0-613c-432e-8961-8eeba2aec3a2 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a2b67328d42c4cc19f04664cda731654&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2116327 Aug 24 03:01:22.654398 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-758febd0-613c-432e-8961-8eeba2aec3a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c501dcd0-080e-4025-ab00-3bee5f78b302,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:22.656303 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 34680) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:22.704758 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-de39b59a-3fbb-4551-b53c-2c662426dcff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:22.725499 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-de39b59a-3fbb-4551-b53c-2c662426dcff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:22.834542 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-de39b59a-3fbb-4551-b53c-2c662426dcff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:22.837171 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-de39b59a-3fbb-4551-b53c-2c662426dcff admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:22.841280 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-de39b59a-3fbb-4551-b53c-2c662426dcff admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c501dcd0-080e-4025-ab00-3bee5f78b302 HTTP/1.1" status: 204 len: 168 time: 0.1838136 Aug 24 03:01:22.849319 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de39b59a-3fbb-4551-b53c-2c662426dcff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c501dcd0-080e-4025-ab00-3bee5f78b302,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:23.699996 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 34728) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:23.971069 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-6670513d-1df1-47e1-af13-94157028f5e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:23.974667 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-aa97951c-3fc7-4d70-ac6e-3fe448ea3c53 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:24.061177 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-aa97951c-3fc7-4d70-ac6e-3fe448ea3c53 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:24.131247 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-aa97951c-3fc7-4d70-ac6e-3fe448ea3c53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:24.172842 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-aa97951c-3fc7-4d70-ac6e-3fe448ea3c53 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a82d421485c84398a145053129aaed31&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4716020 Aug 24 03:01:24.173714 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa97951c-3fc7-4d70-ac6e-3fe448ea3c53 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7180f3c8-faea-4e17-9eaf-64aea1e59d04,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:24.175681 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 34742) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:24.228891 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-52f82178-9cc6-4089-8510-e8d0e913f89d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:24.250511 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-52f82178-9cc6-4089-8510-e8d0e913f89d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:24.336868 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:24.376831 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-52f82178-9cc6-4089-8510-e8d0e913f89d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:24.379447 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-52f82178-9cc6-4089-8510-e8d0e913f89d admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:24.380824 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-52f82178-9cc6-4089-8510-e8d0e913f89d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/7180f3c8-faea-4e17-9eaf-64aea1e59d04 HTTP/1.1" status: 204 len: 168 time: 0.2033341 Aug 24 03:01:24.390419 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52f82178-9cc6-4089-8510-e8d0e913f89d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7180f3c8-faea-4e17-9eaf-64aea1e59d04,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:25.058051 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 34772) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:25.072048 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f02ccfa0-e509-4fb5-bf30-5efbb1accb14 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:25.160716 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f02ccfa0-e509-4fb5-bf30-5efbb1accb14 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:25.235927 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce53872-a588-4f7b-8bb0-2cf6206ec8f6 req-c6b38487-85bf-4519-8f07-e439c18a6c59 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:25.237426 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1ce53872-a588-4f7b-8bb0-2cf6206ec8f6 req-c6b38487-85bf-4519-8f07-e439c18a6c59 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0573101 Aug 24 03:01:25.261751 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f02ccfa0-e509-4fb5-bf30-5efbb1accb14 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:25.315080 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-f02ccfa0-e509-4fb5-bf30-5efbb1accb14 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6664ab493c604eb499261e881dc62e3e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2558312 Aug 24 03:01:25.316160 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f02ccfa0-e509-4fb5-bf30-5efbb1accb14 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bde64de8-927a-4a99-97c5-069f6bf090bb,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:25.317760 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 34780) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:25.326125 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1ce53872-a588-4f7b-8bb0-2cf6206ec8f6 req-1676ee74-ab0e-4280-ac87-d09e555213f4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0814967 Aug 24 03:01:25.384748 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83e88648-27a8-4e86-8d7e-68f56f308135 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:25.404894 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83e88648-27a8-4e86-8d7e-68f56f308135 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:25.525455 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83e88648-27a8-4e86-8d7e-68f56f308135 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:25.528054 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83e88648-27a8-4e86-8d7e-68f56f308135 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:25.529230 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-83e88648-27a8-4e86-8d7e-68f56f308135 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/bde64de8-927a-4a99-97c5-069f6bf090bb HTTP/1.1" status: 204 len: 168 time: 0.2060213 Aug 24 03:01:25.541795 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83e88648-27a8-4e86-8d7e-68f56f308135 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bde64de8-927a-4a99-97c5-069f6bf090bb,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:25.566183 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:26.447857 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-515cc2a8-0b62-495b-8174-83865624464c req-19f25ea6-ed43-4c4a-a9ee-02d6275d4b1c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:26.449480 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-515cc2a8-0b62-495b-8174-83865624464c req-19f25ea6-ed43-4c4a-a9ee-02d6275d4b1c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0506670 Aug 24 03:01:26.485586 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-515cc2a8-0b62-495b-8174-83865624464c req-d8e9be1b-d3d1-4ac0-9abe-ee80a970116a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302567 Aug 24 03:01:26.930782 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:27.601980 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b950684-f093-4fd1-84ac-e025aa2a219d req-dfc3c255-5eb8-47bf-bad8-c376f8e90853 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:27.603210 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9b950684-f093-4fd1-84ac-e025aa2a219d req-dfc3c255-5eb8-47bf-bad8-c376f8e90853 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0518210 Aug 24 03:01:27.642808 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9b950684-f093-4fd1-84ac-e025aa2a219d req-be6d0c1a-07ee-4a3c-9180-6d7ed8729a18 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334423 Aug 24 03:01:28.756766 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05a9449f-2f54-44d7-ae72-2a84973437c4 req-b9f83be1-a5c3-4541-99ec-4467aae6fa38 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:28.758268 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-05a9449f-2f54-44d7-ae72-2a84973437c4 req-b9f83be1-a5c3-4541-99ec-4467aae6fa38 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0478997 Aug 24 03:01:28.794620 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-05a9449f-2f54-44d7-ae72-2a84973437c4 req-72f68d3c-6e1a-43ff-af8b-6a91d7725b84 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304780 Aug 24 03:01:29.915731 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-609a2ef3-f5c2-42e4-8773-40ddf4569185 req-05378671-bdb8-4794-8225-aa33ecf2284b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:29.917196 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-609a2ef3-f5c2-42e4-8773-40ddf4569185 req-05378671-bdb8-4794-8225-aa33ecf2284b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0522640 Aug 24 03:01:29.954506 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-609a2ef3-f5c2-42e4-8773-40ddf4569185 req-638d15fe-3263-4936-9ea7-22508bd5cb1c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312991 Aug 24 03:01:31.071279 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5afbab85-8165-433c-98bb-72b113d969ca req-d0ad9c7b-ca3a-420c-8dc4-027b97c3d705 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:31.072765 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5afbab85-8165-433c-98bb-72b113d969ca req-d0ad9c7b-ca3a-420c-8dc4-027b97c3d705 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0521202 Aug 24 03:01:31.110907 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5afbab85-8165-433c-98bb-72b113d969ca req-6cbb6d0b-8f0c-41a2-955e-b6795ed70141 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321608 Aug 24 03:01:32.229928 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05b29ea9-7e8d-418b-b453-006ee4646b58 req-a71a8b84-0eb2-4e75-8a75-ce27845a3c8d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:32.231424 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-05b29ea9-7e8d-418b-b453-006ee4646b58 req-a71a8b84-0eb2-4e75-8a75-ce27845a3c8d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0519228 Aug 24 03:01:32.269704 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-05b29ea9-7e8d-418b-b453-006ee4646b58 req-127b968a-1d2c-4bd9-948e-e8603f045b10 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322556 Aug 24 03:01:33.395517 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db50cbae-2ec3-46e1-92e0-3977502bc0c2 req-06ee932a-927a-4d63-aadb-bb5ddb32d2da tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:33.398593 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-db50cbae-2ec3-46e1-92e0-3977502bc0c2 req-06ee932a-927a-4d63-aadb-bb5ddb32d2da tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0564675 Aug 24 03:01:33.444167 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-db50cbae-2ec3-46e1-92e0-3977502bc0c2 req-ffdacb1c-4104-4efa-b841-3c5059296a7a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394738 Aug 24 03:01:33.572964 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:01:34.564346 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2055c27-e598-4781-9136-bf17669270eb req-6722fb94-6fde-4e97-8454-9ec187b5d730 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:34.565934 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b2055c27-e598-4781-9136-bf17669270eb req-6722fb94-6fde-4e97-8454-9ec187b5d730 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0553949 Aug 24 03:01:34.607079 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b2055c27-e598-4781-9136-bf17669270eb req-556bf677-553f-43f9-9682-e881fdc72f5b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0345805 Aug 24 03:01:35.174475 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6785bafa-5dc6-4175-9b88-a72ed785b581 req-d273718c-0096-4893-90c4-fe80ab689c83 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0431437 Aug 24 03:01:35.238447 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6785bafa-5dc6-4175-9b88-a72ed785b581 req-613ffa10-595f-4a21-8258-5f0a20413cbc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:35.241018 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6785bafa-5dc6-4175-9b88-a72ed785b581 req-613ffa10-595f-4a21-8258-5f0a20413cbc service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 1098 time: 0.0437856 Aug 24 03:01:35.347661 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6785bafa-5dc6-4175-9b88-a72ed785b581 req-0dbc0b82-7da5-4786-b845-030ef0a93b5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:35.349679 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6785bafa-5dc6-4175-9b88-a72ed785b581 req-0dbc0b82-7da5-4786-b845-030ef0a93b5d service neutron] 10.222.0.43 "GET /v2.0/networks?id=4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 200 len: 919 time: 0.0852392 Aug 24 03:01:35.400382 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6785bafa-5dc6-4175-9b88-a72ed785b581 req-8bc5ab03-6857-473c-83c2-cee56dec2ca3 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=659513ab-6408-4e0e-b7d4-dea0216a385c HTTP/1.1" status: 200 len: 217 time: 0.0367439 Aug 24 03:01:35.469307 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6785bafa-5dc6-4175-9b88-a72ed785b581 req-b1ee70c0-2510-4a54-9ee2-394393b638c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:35.470837 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6785bafa-5dc6-4175-9b88-a72ed785b581 req-b1ee70c0-2510-4a54-9ee2-394393b638c3 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4f536c4e-b790-4630-bdc6-867501285c32 HTTP/1.1" status: 200 len: 858 time: 0.0515223 Aug 24 03:01:35.509633 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6785bafa-5dc6-4175-9b88-a72ed785b581 req-0130e854-1501-40ed-bf74-54e46d26224a service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=4091852f-86f8-4dac-87af-44624502a74d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0289750 Aug 24 03:01:35.640826 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0a7dee4-b0ee-4f79-afd2-e8c33a406470 req-972a56fb-5172-49e6-a2b3-7388d4d0fb33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:35.642411 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c0a7dee4-b0ee-4f79-afd2-e8c33a406470 req-972a56fb-5172-49e6-a2b3-7388d4d0fb33 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 1098 time: 0.1014760 Aug 24 03:01:35.672132 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6785bafa-5dc6-4175-9b88-a72ed785b581 req-4a8ebf20-0496-42fe-b98a-d62d2ec8342e service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1433091 Aug 24 03:01:35.722917 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fbd267b-be51-47a3-ad41-49c47a640795 req-1187372f-5f5c-4d7c-b61f-906875e45f11 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:35.725172 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5fbd267b-be51-47a3-ad41-49c47a640795 req-1187372f-5f5c-4d7c-b61f-906875e45f11 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0501328 Aug 24 03:01:35.762374 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5fbd267b-be51-47a3-ad41-49c47a640795 req-7c6db022-858e-4dc3-96a2-9144a93fa096 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314426 Aug 24 03:01:36.882015 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f968ba-e5e9-45ff-91ea-299b3c7c6a41 req-3c163a23-ddf6-4999-aae1-14ed82d0bdd2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:36.883472 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-95f968ba-e5e9-45ff-91ea-299b3c7c6a41 req-3c163a23-ddf6-4999-aae1-14ed82d0bdd2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0478053 Aug 24 03:01:36.920536 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-95f968ba-e5e9-45ff-91ea-299b3c7c6a41 req-2dffe627-3620-4e6e-9986-740230a0f763 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308847 Aug 24 03:01:37.393541 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c0a7dee4-b0ee-4f79-afd2-e8c33a406470 req-f9d2c5b6-c67d-45c1-81c9-02f3800659f3 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0288918 Aug 24 03:01:37.656497 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:38.039886 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b055251-20ce-4069-a1c1-ce825c2eccc4 req-7dcd22c2-067a-4ca0-a4b7-c53376f4c9ec tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:38.041323 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4b055251-20ce-4069-a1c1-ce825c2eccc4 req-7dcd22c2-067a-4ca0-a4b7-c53376f4c9ec tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0524490 Aug 24 03:01:38.084788 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4b055251-20ce-4069-a1c1-ce825c2eccc4 req-4ed3d7a2-8d90-40e1-8528-23acc05894a3 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374990 Aug 24 03:01:38.767819 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6785bafa-5dc6-4175-9b88-a72ed785b581 req-a076d898-b0ea-49d3-a607-cdce6f16164f service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870168 Aug 24 03:01:39.201231 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ca8d30-d0b0-4c4c-ae7c-7f5e19824d0f req-799b2a24-6b9d-4fe2-8e92-901b835eb3fb tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:39.203056 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-07ca8d30-d0b0-4c4c-ae7c-7f5e19824d0f req-799b2a24-6b9d-4fe2-8e92-901b835eb3fb tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0494566 Aug 24 03:01:39.243161 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-07ca8d30-d0b0-4c4c-ae7c-7f5e19824d0f req-9510611d-de1b-43f9-a678-13ac9f725f97 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0335255 Aug 24 03:01:40.370531 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15976b26-4a0d-4a2e-8364-d4a4eab385fc req-c807e46d-a79b-46bf-bb60-9cfe847471e4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:40.371879 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-15976b26-4a0d-4a2e-8364-d4a4eab385fc req-c807e46d-a79b-46bf-bb60-9cfe847471e4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0476582 Aug 24 03:01:40.411371 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-15976b26-4a0d-4a2e-8364-d4a4eab385fc req-40d97895-7068-4fe5-9df2-59291a26e4f0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331714 Aug 24 03:01:40.809794 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fbb1e93-ef27-44a1-ab53-63075b93cae9 req-5859856b-d553-47f8-afd8-cad95dec090f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:40.811257 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9fbb1e93-ef27-44a1-ab53-63075b93cae9 req-5859856b-d553-47f8-afd8-cad95dec090f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0482783 Aug 24 03:01:40.854236 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9fbb1e93-ef27-44a1-ab53-63075b93cae9 req-37936164-0073-46b4-be9d-128659737fc8 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366275 Aug 24 03:01:44.343031 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd96ebb-45c9-4cf9-b8b7-8a23b3e75465 req-c65b32ea-6317-4dff-9d97-92c9977b7249 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:44.345438 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5dd96ebb-45c9-4cf9-b8b7-8a23b3e75465 req-c65b32ea-6317-4dff-9d97-92c9977b7249 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 1098 time: 0.0435753 Aug 24 03:01:44.447172 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd96ebb-45c9-4cf9-b8b7-8a23b3e75465 req-4087ba61-a4c3-4ecd-9c36-ab2e525d65e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:44.449024 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5dd96ebb-45c9-4cf9-b8b7-8a23b3e75465 req-4087ba61-a4c3-4ecd-9c36-ab2e525d65e5 service neutron] 10.222.0.43 "GET /v2.0/networks?id=4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 200 len: 919 time: 0.0923693 Aug 24 03:01:44.449774 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0aa1a0d-7a43-42de-bea9-c4b0029dbba4 req-77d1b305-8a7e-47c0-b576-dbd110a601ae tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:44.451447 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d0aa1a0d-7a43-42de-bea9-c4b0029dbba4 req-77d1b305-8a7e-47c0-b576-dbd110a601ae tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0561609 Aug 24 03:01:44.492116 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d0aa1a0d-7a43-42de-bea9-c4b0029dbba4 req-cf69b131-e6b1-42e7-b5c8-48af87708c08 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342362 Aug 24 03:01:44.511078 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5dd96ebb-45c9-4cf9-b8b7-8a23b3e75465 req-79b7fa31-8cbc-40dc-92e0-cf6c412ff797 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=706be5c2-c6fb-496a-ac91-104e4cc11ae7 HTTP/1.1" status: 200 len: 217 time: 0.0400283 Aug 24 03:01:44.566322 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd96ebb-45c9-4cf9-b8b7-8a23b3e75465 req-7e3534c2-f6b9-42df-bb78-768e1ffa17fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:44.569379 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5dd96ebb-45c9-4cf9-b8b7-8a23b3e75465 req-7e3534c2-f6b9-42df-bb78-768e1ffa17fb service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4f536c4e-b790-4630-bdc6-867501285c32 HTTP/1.1" status: 200 len: 858 time: 0.0452225 Aug 24 03:01:44.602047 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5dd96ebb-45c9-4cf9-b8b7-8a23b3e75465 req-49ef6c15-156a-4861-aa5f-d33c7e7a38fe service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=4091852f-86f8-4dac-87af-44624502a74d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0247779 Aug 24 03:01:44.696464 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5dd96ebb-45c9-4cf9-b8b7-8a23b3e75465 req-f3aa275b-2c19-45c8-9e89-4be8b007601e service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863941 Aug 24 03:01:44.790896 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5dd96ebb-45c9-4cf9-b8b7-8a23b3e75465 req-4897f2c4-ac18-4f83-bdbf-b4dcce49947f service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844443 Aug 24 03:01:45.620078 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83bf6d6f-f648-433f-8a9a-c6bf90451844 req-6f3c1069-ef83-499d-86ba-1ff53654fe58 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:45.621449 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-83bf6d6f-f648-433f-8a9a-c6bf90451844 req-6f3c1069-ef83-499d-86ba-1ff53654fe58 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0494719 Aug 24 03:01:45.664377 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-83bf6d6f-f648-433f-8a9a-c6bf90451844 req-a7d1decd-e6eb-4f8d-a416-3dd14e88d8cc tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366311 Aug 24 03:01:46.803744 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c551b7-5c41-4db7-93d7-ebd930ff8d77 req-517b6798-93f6-42ec-9916-c131c076bb8c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:46.811178 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-19c551b7-5c41-4db7-93d7-ebd930ff8d77 req-517b6798-93f6-42ec-9916-c131c076bb8c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0631096 Aug 24 03:01:46.865987 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-19c551b7-5c41-4db7-93d7-ebd930ff8d77 req-16d93a25-101f-4169-ab62-1ade2ef3d6af tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496228 Aug 24 03:01:46.970983 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35250) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:47.122077 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:47.213748 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:47.303743 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:47.343610 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=0e83e66420bc4a799b01404dd1f4c2a9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3714807 Aug 24 03:01:47.344735 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9de8619b-e7af-4729-b7f5-f166b848e57e,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:47.346833 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 35276) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:47.353117 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.353471 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.353843 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.354179 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.354512 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.354845 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.355173 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.355514 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.355826 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.356146 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.356465 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.356781 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10a986ac-3584-49cb-bf7d-45242f77ce80 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.397233 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:47.418683 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:47.543343 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 35284) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:47.553817 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:47.556444 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:47.558355 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/9de8619b-e7af-4729-b7f5-f166b848e57e HTTP/1.1" status: 204 len: 168 time: 0.2096131 Aug 24 03:01:47.567866 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9de8619b-e7af-4729-b7f5-f166b848e57e,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:47.576054 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.576359 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.576695 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.577552 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.577933 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.578263 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.578601 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.579126 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.579403 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.579816 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.580244 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.580568 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6977b60a-f450-4b95-be1d-840d9ffad828 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:01:47.664125 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2125c494-9466-483f-b6f3-10ef1c325a57 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:47.765895 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2125c494-9466-483f-b6f3-10ef1c325a57 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:47.891130 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2125c494-9466-483f-b6f3-10ef1c325a57 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:47.935677 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-2125c494-9466-483f-b6f3-10ef1c325a57 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c1904d094f694190a2d2b376ebf59fb8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3912456 Aug 24 03:01:47.937420 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2125c494-9466-483f-b6f3-10ef1c325a57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b535f658-ed3f-4a8f-a82d-ce5da7af1b91,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:47.938698 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35300) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:48.001424 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ea6612-69b7-4018-8945-d8685837f5d3 req-f78e819b-b62d-42cf-b82f-d3d4e8f3edd0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:48.003403 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-67ea6612-69b7-4018-8945-d8685837f5d3 req-f78e819b-b62d-42cf-b82f-d3d4e8f3edd0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0705030 Aug 24 03:01:48.005145 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-aabf702b-b732-4889-929b-810577c4a8a3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:48.031724 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-aabf702b-b732-4889-929b-810577c4a8a3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:48.042688 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-67ea6612-69b7-4018-8945-d8685837f5d3 req-72b00484-2a20-4d70-9d62-99f33809b960 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324640 Aug 24 03:01:48.211221 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-aabf702b-b732-4889-929b-810577c4a8a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:48.214467 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-aabf702b-b732-4889-929b-810577c4a8a3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:48.226034 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-aabf702b-b732-4889-929b-810577c4a8a3 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b535f658-ed3f-4a8f-a82d-ce5da7af1b91 HTTP/1.1" status: 204 len: 168 time: 0.2761474 Aug 24 03:01:48.226034 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aabf702b-b732-4889-929b-810577c4a8a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b535f658-ed3f-4a8f-a82d-ce5da7af1b91,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:48.332826 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35308) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:48.346540 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-21b01e87-63d2-4f9a-b931-7dbf531f5b5c admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:48.450450 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-21b01e87-63d2-4f9a-b931-7dbf531f5b5c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:48.520611 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-21b01e87-63d2-4f9a-b931-7dbf531f5b5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:48.563543 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21b01e87-63d2-4f9a-b931-7dbf531f5b5c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18fbabae-c8cc-4ae8-a111-3674328c9a93,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:48.577437 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-21b01e87-63d2-4f9a-b931-7dbf531f5b5c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=718899ec85fd4595b78086a4adb4eb46&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2434528 Aug 24 03:01:48.580142 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35322) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:48.633443 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c723ae64-b63d-4eef-8424-d39c0d651516 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:48.677531 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c723ae64-b63d-4eef-8424-d39c0d651516 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:48.839688 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c723ae64-b63d-4eef-8424-d39c0d651516 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:48.842273 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c723ae64-b63d-4eef-8424-d39c0d651516 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:48.848361 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-c723ae64-b63d-4eef-8424-d39c0d651516 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/18fbabae-c8cc-4ae8-a111-3674328c9a93 HTTP/1.1" status: 204 len: 168 time: 0.2618132 Aug 24 03:01:48.853278 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c723ae64-b63d-4eef-8424-d39c0d651516 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18fbabae-c8cc-4ae8-a111-3674328c9a93,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:49.014083 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35334) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:49.027843 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-089c8f40-2eb3-44b3-b117-01d80f975026 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:49.123243 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-089c8f40-2eb3-44b3-b117-01d80f975026 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:49.226455 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-089c8f40-2eb3-44b3-b117-01d80f975026 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:49.259883 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-089c8f40-2eb3-44b3-b117-01d80f975026 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e42d634-350f-4980-a2cc-29cc2b67921a,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:49.264174 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-089c8f40-2eb3-44b3-b117-01d80f975026 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=730ad1bcf6d7422ba71b678de7311d3d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2489698 Aug 24 03:01:49.267102 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35338) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:49.318846 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c8014743-0fbe-413f-b945-3b85bf6573cc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:49.340280 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c8014743-0fbe-413f-b945-3b85bf6573cc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:49.439365 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c8014743-0fbe-413f-b945-3b85bf6573cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:49.442641 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c8014743-0fbe-413f-b945-3b85bf6573cc admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:49.446148 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-c8014743-0fbe-413f-b945-3b85bf6573cc admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3e42d634-350f-4980-a2cc-29cc2b67921a HTTP/1.1" status: 204 len: 168 time: 0.1759946 Aug 24 03:01:49.452543 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8014743-0fbe-413f-b945-3b85bf6573cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e42d634-350f-4980-a2cc-29cc2b67921a,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:51.371050 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-081c99ba-6cec-48ee-972c-8a4411cbd93e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:53.069562 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1754232-f3c9-4707-9173-6268cef60ec1 req-6ee0c397-8d2f-4537-bc7a-458f06e2d578 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:53.071299 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a1754232-f3c9-4707-9173-6268cef60ec1 req-6ee0c397-8d2f-4537-bc7a-458f06e2d578 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0520377 Aug 24 03:01:53.109692 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a1754232-f3c9-4707-9173-6268cef60ec1 req-4cb9ecc1-e5ec-4397-ae5e-853bffb408d5 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324628 Aug 24 03:01:53.392612 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35500) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:53.515213 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-e57a588c-d9f2-4973-8912-7fffb654555e admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:53.610466 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-e57a588c-d9f2-4973-8912-7fffb654555e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:53.719413 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-e57a588c-d9f2-4973-8912-7fffb654555e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:53.763722 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-e57a588c-d9f2-4973-8912-7fffb654555e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c41abe8be4114048829bf79d79c79618&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3672326 Aug 24 03:01:53.763722 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e57a588c-d9f2-4973-8912-7fffb654555e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d6e46d3d-0fb4-4b9e-a6b2-bc223606e9ff,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:53.764376 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 35512) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:53.829955 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-73b9eaee-de7c-44bf-bf0f-eba47dee7a46 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:53.868557 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-73b9eaee-de7c-44bf-bf0f-eba47dee7a46 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:53.999864 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-52130f65-7e03-4c93-87f8-d90fce26b1f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:54.034313 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-73b9eaee-de7c-44bf-bf0f-eba47dee7a46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:54.038865 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-73b9eaee-de7c-44bf-bf0f-eba47dee7a46 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:54.043271 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-73b9eaee-de7c-44bf-bf0f-eba47dee7a46 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d6e46d3d-0fb4-4b9e-a6b2-bc223606e9ff HTTP/1.1" status: 204 len: 168 time: 0.2749233 Aug 24 03:01:54.060019 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73b9eaee-de7c-44bf-bf0f-eba47dee7a46 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d6e46d3d-0fb4-4b9e-a6b2-bc223606e9ff,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:54.348233 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:54.418398 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31387c36-b2a9-44e4-8802-999bebf1603f req-2b2c1709-970a-463b-a743-419e7e693623 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:54.431174 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-31387c36-b2a9-44e4-8802-999bebf1603f req-2b2c1709-970a-463b-a743-419e7e693623 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0501864 Aug 24 03:01:54.463423 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-31387c36-b2a9-44e4-8802-999bebf1603f req-0da8e945-0fab-4048-843d-b20732100888 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376036 Aug 24 03:01:54.894331 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 35550) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:54.908583 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7044d103-34b6-4a62-ba7e-4ebae2b7c9df admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:54.991438 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35552) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:55.015582 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7044d103-34b6-4a62-ba7e-4ebae2b7c9df admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.101569 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-26838a2c-3cda-4071-80db-49c1868ce12e admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.165263 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7044d103-34b6-4a62-ba7e-4ebae2b7c9df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.212829 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35562) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:55.218118 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7044d103-34b6-4a62-ba7e-4ebae2b7c9df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ab0851f0-082a-4f0a-9dc2-5f5de873a4a7,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:55.245142 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35568) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:55.246279 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-7044d103-34b6-4a62-ba7e-4ebae2b7c9df admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=afb8289a65394a759b3dc64149381da8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3493288 Aug 24 03:01:55.343312 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-26838a2c-3cda-4071-80db-49c1868ce12e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.344585 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-076e9dfc-679e-4e32-931b-9258b898d6bc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.385442 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-076e9dfc-679e-4e32-931b-9258b898d6bc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.395950 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-77c23dd3-3254-490a-b1f3-c772b387baa7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.400511 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b78156bf-86ba-44a8-97a6-afccc3b23931 req-daf34b62-e41b-4ea2-b4be-ccc1e3f66546 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:55.401921 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b78156bf-86ba-44a8-97a6-afccc3b23931 req-daf34b62-e41b-4ea2-b4be-ccc1e3f66546 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 945 time: 0.0517464 Aug 24 03:01:55.411591 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-26838a2c-3cda-4071-80db-49c1868ce12e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.448793 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b78156bf-86ba-44a8-97a6-afccc3b23931 req-2db0743a-e193-42e2-9ffb-2b28eef52763 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395763 Aug 24 03:01:55.490360 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-26838a2c-3cda-4071-80db-49c1868ce12e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=24626aca896e4fb599a997f46a158d96&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4976916 Aug 24 03:01:55.491090 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26838a2c-3cda-4071-80db-49c1868ce12e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=183862c2-a3c4-438a-a56a-7d099be8f929,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:55.496008 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35576) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:55.579497 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.618168 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-076e9dfc-679e-4e32-931b-9258b898d6bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.620708 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-076e9dfc-679e-4e32-931b-9258b898d6bc admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.621852 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-076e9dfc-679e-4e32-931b-9258b898d6bc admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ab0851f0-082a-4f0a-9dc2-5f5de873a4a7 HTTP/1.1" status: 204 len: 168 time: 0.3739455 Aug 24 03:01:55.641386 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b8bc2ae2-81b6-4e04-b467-dc63af12c736 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.652878 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076e9dfc-679e-4e32-931b-9258b898d6bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab0851f0-082a-4f0a-9dc2-5f5de873a4a7,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:55.672178 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abc22a51-bc9f-4fa3-9875-10a5150d7262 req-08f08be3-c145-4a28-bf61-f636ff4c9015 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:55.673918 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-abc22a51-bc9f-4fa3-9875-10a5150d7262 req-08f08be3-c145-4a28-bf61-f636ff4c9015 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.1273718 Aug 24 03:01:55.703951 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b8bc2ae2-81b6-4e04-b467-dc63af12c736 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.706473 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-77c23dd3-3254-490a-b1f3-c772b387baa7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.756100 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-abc22a51-bc9f-4fa3-9875-10a5150d7262 req-8330e4e0-8a58-4154-9106-9af99188de03 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0708725 Aug 24 03:01:55.879069 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-77c23dd3-3254-490a-b1f3-c772b387baa7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.915878 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b8bc2ae2-81b6-4e04-b467-dc63af12c736 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.918415 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b8bc2ae2-81b6-4e04-b467-dc63af12c736 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:55.919549 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-b8bc2ae2-81b6-4e04-b467-dc63af12c736 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/183862c2-a3c4-438a-a56a-7d099be8f929 HTTP/1.1" status: 204 len: 168 time: 0.4204044 Aug 24 03:01:55.920649 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77c23dd3-3254-490a-b1f3-c772b387baa7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17e1d901-b4d7-40e9-a9f4-d5a0ddbc0e3a,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:55.924900 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-77c23dd3-3254-490a-b1f3-c772b387baa7 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a075f82291c3413ab5e567451e33eaf6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7107909 Aug 24 03:01:55.929739 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 35584) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:01:55.939772 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8bc2ae2-81b6-4e04-b467-dc63af12c736 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=183862c2-a3c4-438a-a56a-7d099be8f929,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:56.000596 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9d195421-8f88-4d55-8c10-c4767e3f9727 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:56.028423 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9d195421-8f88-4d55-8c10-c4767e3f9727 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:56.250359 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9d195421-8f88-4d55-8c10-c4767e3f9727 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:56.252969 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9d195421-8f88-4d55-8c10-c4767e3f9727 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:56.254272 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-9d195421-8f88-4d55-8c10-c4767e3f9727 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/17e1d901-b4d7-40e9-a9f4-d5a0ddbc0e3a HTTP/1.1" status: 204 len: 168 time: 0.3223176 Aug 24 03:01:56.262501 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d195421-8f88-4d55-8c10-c4767e3f9727 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17e1d901-b4d7-40e9-a9f4-d5a0ddbc0e3a,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:56.591838 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76c8c6f3-1172-4561-a128-f1efe9c3c762 req-a6bb6ebd-137e-43cf-8f06-4a4b19cc58ea tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:56.602415 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-76c8c6f3-1172-4561-a128-f1efe9c3c762 req-a6bb6ebd-137e-43cf-8f06-4a4b19cc58ea tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 945 time: 0.0790606 Aug 24 03:01:56.668453 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-76c8c6f3-1172-4561-a128-f1efe9c3c762 req-51142ac3-1124-47ef-95ac-ef42ad95c1a3 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575402 Aug 24 03:01:56.947420 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3bf9b1b-f97f-4daa-94cf-86fc08e9b814 req-e298b3ce-d7ec-4fa3-83fa-8993520c62a8 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:56.949010 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b3bf9b1b-f97f-4daa-94cf-86fc08e9b814 req-e298b3ce-d7ec-4fa3-83fa-8993520c62a8 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.1187730 Aug 24 03:01:56.988700 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:56.998210 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b3bf9b1b-f97f-4daa-94cf-86fc08e9b814 req-424700b6-6704-4543-9394-9fd266cbed0f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397873 Aug 24 03:01:57.284331 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bb2e8ee-475f-43d4-b5c5-974a87363804 req-d26e9a0b-ac35-43ac-9138-32dab21ae38c tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:57.285938 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1bb2e8ee-475f-43d4-b5c5-974a87363804 req-d26e9a0b-ac35-43ac-9138-32dab21ae38c tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.43 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 945 time: 0.0494256 Aug 24 03:01:57.402121 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-1bb2e8ee-475f-43d4-b5c5-974a87363804 req-715c0abc-98ae-476f-aa10-1abe95ccb73b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Deleting port 1022b7c2-e212-4c0a-845d-686500aef4ef {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:01:57.402465 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-1bb2e8ee-475f-43d4-b5c5-974a87363804 req-715c0abc-98ae-476f-aa10-1abe95ccb73b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:57.502735 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-1bb2e8ee-475f-43d4-b5c5-974a87363804 req-715c0abc-98ae-476f-aa10-1abe95ccb73b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] For port 1022b7c2-e212-4c0a-845d-686500aef4ef, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=1022b7c2-e212-4c0a-845d-686500aef4ef,segment=NetworkSegment(8153f8c3-eca4-496c-bd4f-59ba0022c639),segment_id=8153f8c3-eca4-496c-bd4f-59ba0022c639)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:01:57.503094 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-1bb2e8ee-475f-43d4-b5c5-974a87363804 req-715c0abc-98ae-476f-aa10-1abe95ccb73b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:57.516203 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-1bb2e8ee-475f-43d4-b5c5-974a87363804 req-715c0abc-98ae-476f-aa10-1abe95ccb73b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Calling delete_port for 1022b7c2-e212-4c0a-845d-686500aef4ef owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:01:57.753416 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-1bb2e8ee-475f-43d4-b5c5-974a87363804 req-715c0abc-98ae-476f-aa10-1abe95ccb73b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:57.790217 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-715c0abc-98ae-476f-aa10-1abe95ccb73b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Pushing event deleted for resources: {'Port': ['ID=1022b7c2-e212-4c0a-845d-686500aef4ef,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:01:57.790481 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36c8e76-d325-41d8-90a1-eaeeb64dd12f req-4f2263a9-6c34-4ed2-b3e0-8458982fc567 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:57.791980 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c36c8e76-d325-41d8-90a1-eaeeb64dd12f req-4f2263a9-6c34-4ed2-b3e0-8458982fc567 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 867 time: 0.0571976 Aug 24 03:01:57.834797 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c36c8e76-d325-41d8-90a1-eaeeb64dd12f req-1440cfbf-6c18-482c-962e-25af2a9a1299 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330474 Aug 24 03:01:57.837560 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-1bb2e8ee-475f-43d4-b5c5-974a87363804 req-715c0abc-98ae-476f-aa10-1abe95ccb73b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] No DVR routers for this DVR port 1022b7c2-e212-4c0a-845d-686500aef4ef on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:01:57.842684 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-1bb2e8ee-475f-43d4-b5c5-974a87363804 req-715c0abc-98ae-476f-aa10-1abe95ccb73b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:01:57.842684 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1bb2e8ee-475f-43d4-b5c5-974a87363804 req-715c0abc-98ae-476f-aa10-1abe95ccb73b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.43 "DELETE /v2.0/ports/1022b7c2-e212-4c0a-845d-686500aef4ef HTTP/1.1" status: 204 len: 173 time: 0.5337739 Aug 24 03:01:57.842684 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0289ba5c-5475-4c85-ab70-6d9571a8d345', 'name': 'network-vif-deleted', 'tag': '1022b7c2-e212-4c0a-845d-686500aef4ef'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:01:57.844779 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e44848e1-7104-4524-8647-84fd0c3b0fc6" -d '{"events": [{"server_uuid": "0289ba5c-5475-4c85-ab70-6d9571a8d345", "name": "network-vif-deleted", "tag": "1022b7c2-e212-4c0a-845d-686500aef4ef"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:01:57.883000 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:01:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b4a4a180-f508-45f8-a659-abd820ac976a x-openstack-request-id: req-b4a4a180-f508-45f8-a659-abd820ac976a {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:01:57.883000 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0289ba5c-5475-4c85-ab70-6d9571a8d345", "name": "network-vif-deleted", "tag": "1022b7c2-e212-4c0a-845d-686500aef4ef", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:01:57.883000 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b4a4a180-f508-45f8-a659-abd820ac976a {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:01:57.883564 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0289ba5c-5475-4c85-ab70-6d9571a8d345', 'name': 'network-vif-deleted', 'tag': '1022b7c2-e212-4c0a-845d-686500aef4ef', 'status': 'completed', 'code': 200} Aug 24 03:01:58.128387 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee6c3bb-4f27-4c2e-9099-9c0ad7c79e4c req-c2a7f306-a89a-4628-9d81-d274d7bea19b tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:58.130641 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1ee6c3bb-4f27-4c2e-9099-9c0ad7c79e4c req-c2a7f306-a89a-4628-9d81-d274d7bea19b tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0540535 Aug 24 03:01:58.173509 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1ee6c3bb-4f27-4c2e-9099-9c0ad7c79e4c req-2564d2bf-d3df-4483-b9c4-3c449f73caf2 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0353124 Aug 24 03:01:58.945190 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a703c7c1-cc85-4520-80b9-34d98a234c4b req-3dd885fe-66e0-4ab3-bb7c-85e622a67c1c tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=0289ba5c-5475-4c85-ab70-6d9571a8d345 HTTP/1.1" status: 200 len: 210 time: 0.0279617 Aug 24 03:01:59.296119 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-261843a0-c5ca-4961-b7d2-8a04a8b21ce6 req-055196f3-93c6-4a2d-9d2d-50a4c8309e70 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:01:59.298170 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-261843a0-c5ca-4961-b7d2-8a04a8b21ce6 req-055196f3-93c6-4a2d-9d2d-50a4c8309e70 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0512447 Aug 24 03:01:59.339746 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-261843a0-c5ca-4961-b7d2-8a04a8b21ce6 req-8625a1b2-c419-414a-8249-51d5144094d5 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0327101 Aug 24 03:01:59.502530 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 1022b7c2-e212-4c0a-845d-686500aef4ef no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:01:59.523012 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 1022b7c2-e212-4c0a-845d-686500aef4ef {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:01:59.523364 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 1022b7c2-e212-4c0a-845d-686500aef4ef not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:02:00.039247 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35674) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:00.167830 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-601f3bdf-746f-4478-834a-35d7cf78d5b9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:00.252827 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-601f3bdf-746f-4478-834a-35d7cf78d5b9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:00.387878 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-601f3bdf-746f-4478-834a-35d7cf78d5b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:00.429067 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-601f3bdf-746f-4478-834a-35d7cf78d5b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ccbbc62-f169-4765-bc73-d1726dc797e7,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:00.434758 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-601f3bdf-746f-4478-834a-35d7cf78d5b9 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=911b52d6acd840db872669a30f727b8a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3933067 Aug 24 03:02:00.437095 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 35684) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:00.490047 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd6a6f9-5a36-47fb-a705-c639cc72297d req-69c9e2c0-ad3f-49a7-9fa5-9abf65b67579 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:00.491506 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0cd6a6f9-5a36-47fb-a705-c639cc72297d req-69c9e2c0-ad3f-49a7-9fa5-9abf65b67579 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0808959 Aug 24 03:02:00.514084 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7b6b60ea-8729-4758-aacc-4e6742c5afd9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:00.569101 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7b6b60ea-8729-4758-aacc-4e6742c5afd9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:00.583837 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0cd6a6f9-5a36-47fb-a705-c639cc72297d req-8aa84a5e-9edb-48bb-8553-eed163c4c480 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0813353 Aug 24 03:02:00.788979 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7b6b60ea-8729-4758-aacc-4e6742c5afd9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:00.792318 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7b6b60ea-8729-4758-aacc-4e6742c5afd9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:00.793519 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-7b6b60ea-8729-4758-aacc-4e6742c5afd9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6ccbbc62-f169-4765-bc73-d1726dc797e7 HTTP/1.1" status: 204 len: 168 time: 0.3554037 Aug 24 03:02:00.803799 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b6b60ea-8729-4758-aacc-4e6742c5afd9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ccbbc62-f169-4765-bc73-d1726dc797e7,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:01.706304 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f70ea9-d22a-4844-8eb6-143b1e4d4212 req-8c54d383-bf63-44f3-bcaa-5b417cf42378 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:01.708053 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-98f70ea9-d22a-4844-8eb6-143b1e4d4212 req-8c54d383-bf63-44f3-bcaa-5b417cf42378 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0494978 Aug 24 03:02:01.746158 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-98f70ea9-d22a-4844-8eb6-143b1e4d4212 req-7b140e93-4a89-423f-aa70-dc3b364b7e08 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0323374 Aug 24 03:02:01.970375 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 35730) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:02.065226 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1460800652-network', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:02.199555 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Made reservation on behalf of 03198f839b864099b1c011c0fc54c7dd for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:02:02.201819 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:02.211033 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:02.294653 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:02.393675 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:02.417306 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] vlan segment allocate from pool success with {'vlan_id': 385, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:02:02.425604 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=03c01284-7898-44dd-b693-b74d809408d3,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:02.431806 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:02.432181 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Added segment fb76a34d-79be-499b-a9c7-0f51849f60f3 of type vlan for network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 Aug 24 03:02:02.472219 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:02.576352 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:02.577298 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:02.577907 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:02.634386 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] Pushing event updated for resources: {'Network': ['ID=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:02.648760 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:02:02.687621 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35738) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:02.688086 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-742d4170-7ab1-4269-8589-b7c75a1d36db admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7143245 Aug 24 03:02:02.689848 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-5cd3d86e-6251-4ebd-afb4-b451cbd8456c admin admin] Request body: {'subnet': {'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1460800652-subnet', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'ip_version': 4}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:02.776609 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5cd3d86e-6251-4ebd-afb4-b451cbd8456c admin admin] Made reservation on behalf of 03198f839b864099b1c011c0fc54c7dd for: {'subnet': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:02:02.778611 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-5cd3d86e-6251-4ebd-afb4-b451cbd8456c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25854793'] for subnet, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:02.862490 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa8e5be0-3d11-4cbc-971a-d87044eac4b5 req-8e8f9800-e7af-4acc-bc64-2307c130b5a5 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:02.865421 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fa8e5be0-3d11-4cbc-971a-d87044eac4b5 req-8e8f9800-e7af-4acc-bc64-2307c130b5a5 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0503674 Aug 24 03:02:02.903428 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fa8e5be0-3d11-4cbc-971a-d87044eac4b5 req-7ce758d8-c09c-4912-bfc2-84db024ef21b tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318742 Aug 24 03:02:03.016588 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-5cd3d86e-6251-4ebd-afb4-b451cbd8456c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3523558', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25854779'] for subnet, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:03.065352 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cd3d86e-6251-4ebd-afb4-b451cbd8456c admin admin] Pushing event updated for resources: {'Subnet': ['ID=9d24a59e-1441-41fd-b523-3368836ed9c4,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:03.080267 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cd3d86e-6251-4ebd-afb4-b451cbd8456c admin admin] Checking segment: {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:02:03.080621 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cd3d86e-6251-4ebd-afb4-b451cbd8456c admin admin] Network hostable DHCP agents. Network: 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111276) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:02:03.232924 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cd3d86e-6251-4ebd-afb4-b451cbd8456c admin admin] Network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111276) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:02:03.330430 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-5cd3d86e-6251-4ebd-afb4-b451cbd8456c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6) {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:02:03.335546 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5cd3d86e-6251-4ebd-afb4-b451cbd8456c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:03.336117 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-5cd3d86e-6251-4ebd-afb4-b451cbd8456c admin admin] Notify callbacks [] for subnet, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:03.341961 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75b28d57-049f-45d2-b330-503a0c077235 None None] Network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:02:03.434464 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-5cd3d86e-6251-4ebd-afb4-b451cbd8456c admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.7498043 Aug 24 03:02:03.437437 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35744) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:03.441807 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:03.482441 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc8ebca0a-8efd-5c96-8278-1a4ec08c6f82-3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4'}]}} from dv-cinder-803748-8-iscsi. {{(pid=111277) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Aug 24 03:02:03.483284 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:03.531072 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-560365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32717'] for router, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:03.532203 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-560249', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-569518', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-437890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32692'] for router, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:03.584539 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:03.616727 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.db_base_plugin_common [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Allocated IP 172.20.0.2 (3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6/9d24a59e-1441-41fd-b523-3368836ed9c4/aa1019b3-2b1f-46ea-b266-575c301f0fc2) {{(pid=111277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:02:03.767630 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Notify callbacks [] for port, precommit_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:03.779282 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Transition to ACTIVE for port object aa1019b3-2b1f-46ea-b266-575c301f0fc2 will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:03.800339 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Transition to ACTIVE for port object aa1019b3-2b1f-46ea-b266-575c301f0fc2 will not be triggered until provisioned by entity DHCP. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:03.813036 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:03.862572 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:03.900820 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 is already hosted by enough agents. {{(pid=111277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:02:03.903457 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.base_scheduler [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Resources bound (agent type, host, resource id): {{(pid=111277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:02:03.906479 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Received port after_create {{(pid=111277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:02:03.918194 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Pushing event updated for resources: {'Port': ['ID=aa1019b3-2b1f-46ea-b266-575c301f0fc2,revision_number=1']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:03.942607 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:03.946199 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:03.946199 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:03.946199 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:03.946199 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:03.946199 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:03.946199 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:03.946199 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:03.946765 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:03.946765 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:03.946922 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:03.947211 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:03.987942 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Attempting to bind port aa1019b3-2b1f-46ea-b266-575c301f0fc2 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:02:03.988314 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Attempting to bind port aa1019b3-2b1f-46ea-b266-575c301f0fc2 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:02:03.989030 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Attempting to bind port aa1019b3-2b1f-46ea-b266-575c301f0fc2 on network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:02:03.995861 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 1, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:02:03.996346 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Checking segment: {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:02:03.996847 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:03.997240 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Bound using segment: {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:02:03.998003 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Bound port: aa1019b3-2b1f-46ea-b266-575c301f0fc2, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:02:03.998390 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:04.046734 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59e5da8f-afca-4edb-9f5e-bb8cf958c468 req-38c98045-50db-460e-96e7-210674a596d2 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:04.048220 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-59e5da8f-afca-4edb-9f5e-bb8cf958c468 req-38c98045-50db-460e-96e7-210674a596d2 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0527506 Aug 24 03:02:04.086103 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-8670526a-65ce-451e-918b-d14517122e3c None None] For port aa1019b3-2b1f-46ea-b266-575c301f0fc2, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:02:04.088642 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-59e5da8f-afca-4edb-9f5e-bb8cf958c468 req-0881f40e-2f97-4a1a-af92-9a7fb07cab2d tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0333576 Aug 24 03:02:04.089653 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-8670526a-65ce-451e-918b-d14517122e3c None None] For port aa1019b3-2b1f-46ea-b266-575c301f0fc2, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=aa1019b3-2b1f-46ea-b266-575c301f0fc2,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:02:04.146631 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:04.167666 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:04.240483 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:04.269967 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Allocated IP 172.27.2.120 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/ccb38e4a-a5cf-4b55-9e55-d894d0b923d5) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:02:04.297248 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8670526a-65ce-451e-918b-d14517122e3c None None] Pushing event updated for resources: {'Port': ['ID=aa1019b3-2b1f-46ea-b266-575c301f0fc2,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:04.384369 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:04.835344 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:04.881378 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:02:04.884293 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:02:04.887767 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:02:04.921084 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Pushing event updated for resources: {'Port': ['ID=ccb38e4a-a5cf-4b55-9e55-d894d0b923d5,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:05.057341 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device aa1019b3-2b1f-46ea-b266-575c301f0fc2 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:05.217803 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port aa1019b3-2b1f-46ea-b266-575c301f0fc2 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:02:05.266501 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acbb2f33-95ab-4eef-8879-d3bbaba5d564 req-21be5597-5f53-459b-bb55-ff7c8fce3289 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:05.268105 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-acbb2f33-95ab-4eef-8879-d3bbaba5d564 req-21be5597-5f53-459b-bb55-ff7c8fce3289 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.1007798 Aug 24 03:02:05.287885 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9d4a660-61ca-4655-93d9-03b310a11a46 None None] Network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:02:05.353143 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-acbb2f33-95ab-4eef-8879-d3bbaba5d564 req-18ee8f1d-183c-48c6-b683-505e7ce79d10 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0768809 Aug 24 03:02:05.375456 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:05.514873 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-6b717779-e51c-4ebd-9225-64c236b9832a None None] Provisioning for port aa1019b3-2b1f-46ea-b266-575c301f0fc2 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:02:05.518845 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-6b717779-e51c-4ebd-9225-64c236b9832a None None] Provisioning complete for port aa1019b3-2b1f-46ea-b266-575c301f0fc2 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:05.519221 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-6b717779-e51c-4ebd-9225-64c236b9832a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:05.594863 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f8b27ae-4759-4b99-8d39-583b45eee5b5 req-43a667d0-b333-48ea-804f-09f47d5e7331 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:05.596584 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2f8b27ae-4759-4b99-8d39-583b45eee5b5 req-43a667d0-b333-48ea-804f-09f47d5e7331 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.1628578 Aug 24 03:02:05.625336 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-6b717779-e51c-4ebd-9225-64c236b9832a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:05.676562 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-6b717779-e51c-4ebd-9225-64c236b9832a None None] For port aa1019b3-2b1f-46ea-b266-575c301f0fc2, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=aa1019b3-2b1f-46ea-b266-575c301f0fc2,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:05.689162 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2f8b27ae-4759-4b99-8d39-583b45eee5b5 req-097ce583-64fe-4862-af17-b14afb508c4c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0851576 Aug 24 03:02:05.698883 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3003ec3e-4c23-4401-8639-def204ce64e2 req-7640ef7d-90a6-45de-9d15-941b7562069c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:05.700367 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3003ec3e-4c23-4401-8639-def204ce64e2 req-7640ef7d-90a6-45de-9d15-941b7562069c service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 1098 time: 0.1453772 Aug 24 03:02:05.703137 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-560242', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-569595'] for router, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:05.759326 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-6b717779-e51c-4ebd-9225-64c236b9832a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:05.809392 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b717779-e51c-4ebd-9225-64c236b9832a None None] Pushing event updated for resources: {'Port': ['ID=aa1019b3-2b1f-46ea-b266-575c301f0fc2,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:05.881267 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-8060d9b8-74b5-46a3-9309-a292c3427010 None None] Provisioning complete for port aa1019b3-2b1f-46ea-b266-575c301f0fc2 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:05.881932 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-8060d9b8-74b5-46a3-9309-a292c3427010 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:05.885613 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3003ec3e-4c23-4401-8639-def204ce64e2 req-e29ea82d-eb31-4379-917e-45dfdc76f1ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:05.887079 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3003ec3e-4c23-4401-8639-def204ce64e2 req-e29ea82d-eb31-4379-917e-45dfdc76f1ec service neutron] 10.222.0.43 "GET /v2.0/networks?id=4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 200 len: 919 time: 0.1719458 Aug 24 03:02:05.939063 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3003ec3e-4c23-4401-8639-def204ce64e2 req-4c8b0bbd-1e9c-4ce0-a470-df1b127437ef service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=706be5c2-c6fb-496a-ac91-104e4cc11ae7 HTTP/1.1" status: 200 len: 217 time: 0.0393975 Aug 24 03:02:06.000726 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3003ec3e-4c23-4401-8639-def204ce64e2 req-5003735d-3485-43c1-b0ad-242c2249dbfb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:06.003564 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3003ec3e-4c23-4401-8639-def204ce64e2 req-5003735d-3485-43c1-b0ad-242c2249dbfb service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4f536c4e-b790-4630-bdc6-867501285c32 HTTP/1.1" status: 200 len: 858 time: 0.0497875 Aug 24 03:02:06.064453 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3003ec3e-4c23-4401-8639-def204ce64e2 req-eb5efb31-d166-4569-8bdd-22ecc9aff830 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=4091852f-86f8-4dac-87af-44624502a74d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0311198 Aug 24 03:02:06.067689 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca is scheduled to L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 with binding_index 1 {{(pid=111276) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Aug 24 03:02:06.242852 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3003ec3e-4c23-4401-8639-def204ce64e2 req-cfefa672-3868-4af5-a958-f03c4bc57b35 service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1686580 Aug 24 03:02:06.250945 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:02:06.261445 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Sync routers for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:02:06.273304 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:02:06.273963 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:01:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:06.371117 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3003ec3e-4c23-4401-8639-def204ce64e2 req-2dc1486b-03ed-4f37-88a8-2df76c859633 service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1068325 Aug 24 03:02:06.385265 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:02:06.411186 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] Notify callbacks [] for router, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:06.413475 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-857afef3-f42a-4bd1-b3e2-8331aff27fa6 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.9750683 Aug 24 03:02:06.416336 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 35826) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:06.499485 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfb29bc6-b7ac-4401-bc8a-364d8c4da501 req-d6625961-751f-4acf-a5d1-746233aa1b3b tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:06.501031 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cfb29bc6-b7ac-4401-bc8a-364d8c4da501 req-d6625961-751f-4acf-a5d1-746233aa1b3b tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0601528 Aug 24 03:02:06.556999 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cfb29bc6-b7ac-4401-bc8a-364d8c4da501 req-76450979-63ab-4f9a-98a8-a4cf5dc73fa3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493965 Aug 24 03:02:06.613079 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:05Z', 'revision_number': 3, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:06.650223 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Checking router: 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:02:06.650572 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Updating router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca port ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 binding host dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:02:06.688764 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:06.963957 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device aa1019b3-2b1f-46ea-b266-575c301f0fc2 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:07.008629 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Notify callbacks [] for port, precommit_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:07.021619 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.provisioning_blocks [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Transition to ACTIVE for port object ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 will not be triggered until provisioned by entity L2. {{(pid=111278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:07.028204 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port aa1019b3-2b1f-46ea-b266-575c301f0fc2 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:07.028578 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:07.079820 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-528c1fb3-7682-4e2a-8263-6c9bc6ea6b99 req-6fc0734f-e1b2-4c48-ae6c-bb5b92b46bed tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:07.086132 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-528c1fb3-7682-4e2a-8263-6c9bc6ea6b99 req-6fc0734f-e1b2-4c48-ae6c-bb5b92b46bed tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.3016126 Aug 24 03:02:07.102342 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:07.158010 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Attempting to bind port ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:02:07.158378 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Attempting to bind port ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:02:07.158734 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Attempting to bind port ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 on network 63097abe-4b2c-457b-a244-629c1feb1fe5 {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:02:07.167719 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Pushing event updated for resources: {'Port': ['ID=ccb38e4a-a5cf-4b55-9e55-d894d0b923d5,revision_number=2']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:07.170653 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 1, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:02:07.170653 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Checking segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:02:07.171011 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:07.171403 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Bound using segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:02:07.171857 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Bound port: ccb38e4a-a5cf-4b55-9e55-d894d0b923d5, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:02:07.172255 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:07.188223 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-528c1fb3-7682-4e2a-8263-6c9bc6ea6b99 req-dca20a4d-95b5-45f8-a002-e184c2d68de8 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0742779 Aug 24 03:02:07.201195 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:07.201607 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:07.201828 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:07.202165 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:07.202501 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:07.202821 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:07.203198 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:07.203463 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:07.203785 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:07.204123 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:07.204447 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:07.204765 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:07.205078 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:07.244041 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] For port ccb38e4a-a5cf-4b55-9e55-d894d0b923d5, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:02:07.245210 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] For port ccb38e4a-a5cf-4b55-9e55-d894d0b923d5, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=ccb38e4a-a5cf-4b55-9e55-d894d0b923d5,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:02:07.302753 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:07.350784 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:02:07.351411 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:01:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:07.366821 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Allocated IP 172.20.0.1 (3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6/9d24a59e-1441-41fd-b523-3368836ed9c4/4b3cf046-5f07-4c52-b229-289330f08157) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:02:07.406224 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8f1e104-339d-45cc-94e0-1476a4a99783 None None] Pushing event updated for resources: {'Port': ['ID=ccb38e4a-a5cf-4b55-9e55-d894d0b923d5,revision_number=3']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:07.477358 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:07.492589 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.provisioning_blocks [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Transition to ACTIVE for port object 4b3cf046-5f07-4c52-b229-289330f08157 will not be triggered until provisioned by entity DHCP. {{(pid=111275) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:07.557561 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:02:07.584383 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:07.622625 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:02:07.625447 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:02:07.628835 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:02:07.680559 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Pushing event updated for resources: {'Port': ['ID=4b3cf046-5f07-4c52-b229-289330f08157,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:07.700174 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-571748'] for router_interface, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:07.757731 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:05Z', 'revision_number': 3, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:07.797517 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fd73767-080d-4f36-9aa2-fbf86daa0ac8 None None] The sync data for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi is: [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:05Z', 'revision_number': 3, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:02:07.802743 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f98a2d-df44-4419-8b3b-14ff3d49549c req-5f2f9057-28a3-4f97-817d-8389ab675ede tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:07.811641 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d6f98a2d-df44-4419-8b3b-14ff3d49549c req-5f2f9057-28a3-4f97-817d-8389ab675ede tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.1524901 Aug 24 03:02:07.874241 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d6f98a2d-df44-4419-8b3b-14ff3d49549c req-89df78d6-0062-4208-b09a-b36f099a178e tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0617795 Aug 24 03:02:08.008370 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:08.031226 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:08.035830 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b262508-577c-4313-9563-b9ac665b0d6c None None] Provisioning for port 4b3cf046-5f07-4c52-b229-289330f08157 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:02:08.047386 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b262508-577c-4313-9563-b9ac665b0d6c None None] Provisioning complete for port 4b3cf046-5f07-4c52-b229-289330f08157 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:08.047778 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b262508-577c-4313-9563-b9ac665b0d6c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:08.085839 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b262508-577c-4313-9563-b9ac665b0d6c None None] Port 4b3cf046-5f07-4c52-b229-289330f08157 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:02:08.202628 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Notify callbacks [] for port, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:08.307282 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3484283'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:08.391583 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c646e92f-95dc-4dfe-9e11-f3bd1f4371ab req-62e05666-521a-4afd-8bdc-3d66f0baa90f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:08.393147 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c646e92f-95dc-4dfe-9e11-f3bd1f4371ab req-62e05666-521a-4afd-8bdc-3d66f0baa90f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.1170855 Aug 24 03:02:08.394137 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Pushing event updated for resources: {'Port': ['ID=4b3cf046-5f07-4c52-b229-289330f08157,revision_number=2']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:08.397129 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-748278', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-571822'] for router_interface, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:08.482612 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c646e92f-95dc-4dfe-9e11-f3bd1f4371ab req-172dd59d-7be9-4e6b-a44d-ae2ba50a3341 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820227 Aug 24 03:02:08.518982 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:02:08.520291 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:02:08.635100 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:02:08.707429 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-0b3df2b2-96f8-45b7-a8b8-6a993114e474 None None] Provisioning complete for port 4b3cf046-5f07-4c52-b229-289330f08157 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:08.707910 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-0b3df2b2-96f8-45b7-a8b8-6a993114e474 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:08.745809 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-0b3df2b2-96f8-45b7-a8b8-6a993114e474 None None] Port 4b3cf046-5f07-4c52-b229-289330f08157 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:02:08.747738 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:02:08.752968 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-99f1dc53-220e-4988-83f9-97580e91f04c admin admin] 10.222.0.30 "PUT /v2.0/routers/5a2fd9fa-c21b-4040-88a2-5ddfbec68dca/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3354871 Aug 24 03:02:08.981227 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:09.021196 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c5949b-583f-4ccb-8c75-db0141eb221f req-db09208a-9c55-4c7a-93a1-542bf14443e6 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:09.023308 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-96c5949b-583f-4ccb-8c75-db0141eb221f req-db09208a-9c55-4c7a-93a1-542bf14443e6 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0675492 Aug 24 03:02:09.063133 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-96c5949b-583f-4ccb-8c75-db0141eb221f req-df49a29f-6a5b-48c0-ac20-3d8d9513d53d tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0332797 Aug 24 03:02:09.091070 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:02:09.095527 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:09.095936 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:09.296012 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:09.302925 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Sync routers for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:02:09.323917 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:02:09.324557 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:01:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:09.329654 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port ccb38e4a-a5cf-4b55-9e55-d894d0b923d5, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=ccb38e4a-a5cf-4b55-9e55-d894d0b923d5,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:09.407681 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:09.458160 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 35892) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:09.463568 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-99759354-network', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:09.465519 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:02:09.502604 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=ccb38e4a-a5cf-4b55-9e55-d894d0b923d5,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:09.541962 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Made reservation on behalf of 3cbdbe4be9884f938ca1bbfbe2d22f34 for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:02:09.544701 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:09.556770 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:09.618144 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4c94cb6-88e6-4597-bc05-ea93c259eaaa req-961013fe-c31c-40ed-ab2b-01c4f214868c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:09.619942 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b4c94cb6-88e6-4597-bc05-ea93c259eaaa req-961013fe-c31c-40ed-ab2b-01c4f214868c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0652118 Aug 24 03:02:09.677869 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b4c94cb6-88e6-4597-bc05-ea93c259eaaa req-bf199b69-5386-4948-98d8-6f96e38346a9 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481710 Aug 24 03:02:09.680218 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:08Z', 'revision_number': 2, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:09.708255 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Checking router: 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:02:09.711672 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Updating router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca port 4b3cf046-5f07-4c52-b229-289330f08157 binding host dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:02:09.721919 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:09.733534 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:09.834476 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:09.852811 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] vlan segment allocate from pool success with {'vlan_id': 365, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:02:09.869759 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:09.870101 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Added segment 7f24683c-fde3-41b9-a14e-aac1a7e5eb69 of type vlan for network 13c627dc-b4e4-4312-bbc3-d825db999a37 Aug 24 03:02:09.871262 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=371b3216-bbc7-405e-9569-4ba898577aaf,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:09.912836 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:10.024974 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Notify callbacks [] for port, precommit_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:10.034797 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Transition to ACTIVE for port object 4b3cf046-5f07-4c52-b229-289330f08157 will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:10.039622 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:10.041746 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:10.041746 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:10.100065 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] Pushing event updated for resources: {'Network': ['ID=13c627dc-b4e4-4312-bbc3-d825db999a37,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:10.109683 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 13c627dc-b4e4-4312-bbc3-d825db999a37 details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:02:10.154770 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:10.187872 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3df7615c-bf54-4e12-96c5-349f93f718d4 req-0ab58f0c-8c6d-4fe7-a66e-568a9c296d48 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:10.189417 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3df7615c-bf54-4e12-96c5-349f93f718d4 req-0ab58f0c-8c6d-4fe7-a66e-568a9c296d48 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0532234 Aug 24 03:02:10.226645 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-cd7c006f-5f4a-41b0-97ce-6a711d1dc7c2 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.7670107 Aug 24 03:02:10.229598 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 35902) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:10.236834 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-3511e59b-9aca-40d1-a836-f33d9f1894c1 admin admin] Request body: {'subnet': {'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-99759354-subnet', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'ip_version': 4}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:10.251857 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3df7615c-bf54-4e12-96c5-349f93f718d4 req-45d7886e-3d4f-4417-9d51-796bd4168ff0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535836 Aug 24 03:02:10.272990 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a787258-bc86-458d-a00b-6ce67ba21ddc None None] Pushing event updated for resources: {'Port': ['ID=4b3cf046-5f07-4c52-b229-289330f08157,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:10.277665 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Attempting to bind port 4b3cf046-5f07-4c52-b229-289330f08157 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:02:10.278236 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Attempting to bind port 4b3cf046-5f07-4c52-b229-289330f08157 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:02:10.278595 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Attempting to bind port 4b3cf046-5f07-4c52-b229-289330f08157 on network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:02:10.283662 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 1, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:02:10.284131 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Checking segment: {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:02:10.284429 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:10.288402 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Bound using segment: {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:02:10.288402 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Bound port: 4b3cf046-5f07-4c52-b229-289330f08157, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:02:10.288402 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:10.351681 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] For port 4b3cf046-5f07-4c52-b229-289330f08157, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:02:10.354933 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] For port 4b3cf046-5f07-4c52-b229-289330f08157, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=4b3cf046-5f07-4c52-b229-289330f08157,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:02:10.428136 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3511e59b-9aca-40d1-a836-f33d9f1894c1 admin admin] Made reservation on behalf of 3cbdbe4be9884f938ca1bbfbe2d22f34 for: {'subnet': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:02:10.430583 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3511e59b-9aca-40d1-a836-f33d9f1894c1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3378795'] for subnet, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:10.479687 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:10.541884 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:02:10.544056 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:01:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:10.547624 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a787258-bc86-458d-a00b-6ce67ba21ddc None None] Pushing event updated for resources: {'Port': ['ID=4b3cf046-5f07-4c52-b229-289330f08157,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:10.572770 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:02:10.661075 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:02:10.679695 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3511e59b-9aca-40d1-a836-f33d9f1894c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483122', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3378713'] for subnet, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:10.732679 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3511e59b-9aca-40d1-a836-f33d9f1894c1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4b7095fd-e503-473e-b61b-354e0711f169,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:10.750862 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3511e59b-9aca-40d1-a836-f33d9f1894c1 admin admin] Checking segment: {'id': '7f24683c-fde3-41b9-a14e-aac1a7e5eb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:02:10.751302 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3511e59b-9aca-40d1-a836-f33d9f1894c1 admin admin] Network hostable DHCP agents. Network: 13c627dc-b4e4-4312-bbc3-d825db999a37, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111275) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:02:10.820298 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb9dd53e-a610-4634-ae1f-ba38793ccfba req-87278618-b318-4f09-9eca-e714ad17af4f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:10.826736 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb9dd53e-a610-4634-ae1f-ba38793ccfba req-87278618-b318-4f09-9eca-e714ad17af4f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0534143 Aug 24 03:02:10.845017 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3511e59b-9aca-40d1-a836-f33d9f1894c1 admin admin] Network 13c627dc-b4e4-4312-bbc3-d825db999a37 is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111275) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:02:10.863417 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb9dd53e-a610-4634-ae1f-ba38793ccfba req-e8553385-f06b-4231-83b7-a66b8a94979b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340388 Aug 24 03:02:10.892394 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:10Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:10.919753 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c09a970-2417-4209-a8e8-78197f0ff702 None None] The sync data for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi is: [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:10Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:02:10.930827 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-3511e59b-9aca-40d1-a836-f33d9f1894c1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 13c627dc-b4e4-4312-bbc3-d825db999a37) {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:02:10.935125 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3511e59b-9aca-40d1-a836-f33d9f1894c1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:10.935761 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3511e59b-9aca-40d1-a836-f33d9f1894c1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:10.942749 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aac65f6a-c997-4aa5-871d-c2980fe37270 None None] Network 13c627dc-b4e4-4312-bbc3-d825db999a37 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:02:11.016582 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:11.035748 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-3511e59b-9aca-40d1-a836-f33d9f1894c1 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.8048937 Aug 24 03:02:11.038647 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 35926) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:11.054237 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-99759354-router', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:11.134680 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:11.135293 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:11.191638 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-d4df8c2e-7814-4abe-8c62-6e5f3afd48fd tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:11.193118 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-d4df8c2e-7814-4abe-8c62-6e5f3afd48fd tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/networks?id=f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee HTTP/1.1" status: 200 len: 814 time: 0.1229053 Aug 24 03:02:11.212719 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc8ebca0a-8efd-5c96-8278-1a4ec08c6f82-13c627dc-b4e4-4312-bbc3-d825db999a37', 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'fixed_ips': [{'subnet_id': '4b7095fd-e503-473e-b61b-354e0711f169'}]}} from dv-cinder-803748-8-iscsi. {{(pid=111277) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Aug 24 03:02:11.213572 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:11.215858 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-c4a59fb8-eb0c-43db-a43b-10c59ff6a273 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/quotas/3b289da7de434e9ca4c67edc2769c6ab HTTP/1.1" status: 200 len: 375 time: 0.0115473 Aug 24 03:02:11.217093 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-560365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32717'] for router, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:11.218341 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-560249', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-569518', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-437890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32692'] for router, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:11.274218 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-f8f573e2-9221-496a-ae47-1cd5e35ec4ce tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=3b289da7de434e9ca4c67edc2769c6ab&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0490913 Aug 24 03:02:11.387487 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:11.414769 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d980a82-675a-423b-9638-624aee4d4bc3 req-56586834-f24c-49c1-8a5f-2cba5ad409b7 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:11.416684 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2d980a82-675a-423b-9638-624aee4d4bc3 req-56586834-f24c-49c1-8a5f-2cba5ad409b7 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0604634 Aug 24 03:02:11.418324 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.db_base_plugin_common [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Allocated IP 172.20.0.2 (13c627dc-b4e4-4312-bbc3-d825db999a37/4b7095fd-e503-473e-b61b-354e0711f169/aa09f096-8701-4649-8c74-e8883e55ee7e) {{(pid=111277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:02:11.428654 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-7047130d-7a08-4155-b7f8-b5f56dbc6a2f service neutron] 10.222.0.30 "GET /v2.0/networks/f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1535611 Aug 24 03:02:11.465620 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2d980a82-675a-423b-9638-624aee4d4bc3 req-75929fe3-25a0-4c3f-9fed-d8d5d3217a76 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419614 Aug 24 03:02:11.626353 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Notify callbacks [] for port, precommit_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:11.636524 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Transition to ACTIVE for port object aa09f096-8701-4649-8c74-e8883e55ee7e will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:11.654320 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Transition to ACTIVE for port object aa09f096-8701-4649-8c74-e8883e55ee7e will not be triggered until provisioned by entity DHCP. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:11.742911 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:11.785483 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Network 13c627dc-b4e4-4312-bbc3-d825db999a37 is already hosted by enough agents. {{(pid=111277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:02:11.789653 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.base_scheduler [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Resources bound (agent type, host, resource id): {{(pid=111277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:02:11.793202 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Received port after_create {{(pid=111277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:02:11.804273 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Pushing event updated for resources: {'Port': ['ID=aa09f096-8701-4649-8c74-e8883e55ee7e,revision_number=1']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:11.861100 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Attempting to bind port aa09f096-8701-4649-8c74-e8883e55ee7e on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:02:11.861470 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Attempting to bind port aa09f096-8701-4649-8c74-e8883e55ee7e by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '7f24683c-fde3-41b9-a14e-aac1a7e5eb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:02:11.861867 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Attempting to bind port aa09f096-8701-4649-8c74-e8883e55ee7e on network 13c627dc-b4e4-4312-bbc3-d825db999a37 {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:02:11.867070 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 1, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:02:11.867451 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Checking segment: {'id': '7f24683c-fde3-41b9-a14e-aac1a7e5eb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:02:11.867849 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:11.868459 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Bound using segment: {'id': '7f24683c-fde3-41b9-a14e-aac1a7e5eb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:02:11.868703 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Bound port: aa09f096-8701-4649-8c74-e8883e55ee7e, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7f24683c-fde3-41b9-a14e-aac1a7e5eb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:02:11.869087 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:11.912423 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:11.937427 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] For port aa09f096-8701-4649-8c74-e8883e55ee7e, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:02:11.938574 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-c8ae823b-3ac1-418e-83e6-25988822d8ef service neutron] 10.222.0.30 "GET /v2.0/networks/f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4999044 Aug 24 03:02:11.941447 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] For port aa09f096-8701-4649-8c74-e8883e55ee7e, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=aa09f096-8701-4649-8c74-e8883e55ee7e,segment=NetworkSegment(7f24683c-fde3-41b9-a14e-aac1a7e5eb69),segment_id=7f24683c-fde3-41b9-a14e-aac1a7e5eb69)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:02:12.011810 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:12.091541 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e69de478-c094-4ee9-a2d5-31e83e6f6c03 None None] Pushing event updated for resources: {'Port': ['ID=aa09f096-8701-4649-8c74-e8883e55ee7e,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:12.126980 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e160a8-357e-4646-abbd-df4e4f6bf060 req-d65017a0-eec6-4eb2-a4c9-ec4c6d28355a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:12.140029 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-72e160a8-357e-4646-abbd-df4e4f6bf060 req-d65017a0-eec6-4eb2-a4c9-ec4c6d28355a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0715926 Aug 24 03:02:12.196642 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-72e160a8-357e-4646-abbd-df4e4f6bf060 req-790f6bb1-7fe0-4db2-9f57-6a21bc466822 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510814 Aug 24 03:02:12.257966 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-abe55074-5039-4213-a30f-b5e6e5a5b576 req-48879910-5fc2-4ca2-9990-27778b9cd7b0 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 210 time: 0.0361102 Aug 24 03:02:12.308979 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:12.338280 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:12.464872 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Allocated IP 172.27.2.78 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/984621a4-5382-4c35-8a6e-b1485ece36ab) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:02:12.574869 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:12.587852 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf2ad64-b210-4989-b179-bb9384fd09cd req-2b3060db-212d-41ea-a873-6c5d08574a9b tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:12.589442 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4cf2ad64-b210-4989-b179-bb9384fd09cd req-2b3060db-212d-41ea-a873-6c5d08574a9b tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0497224 Aug 24 03:02:12.646043 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4cf2ad64-b210-4989-b179-bb9384fd09cd req-681486f4-4515-41d0-a0f4-c90af52760c4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479724 Aug 24 03:02:12.730999 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:12.771282 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:02:12.774054 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:02:12.780634 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:02:12.784075 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Pushing event updated for resources: {'Port': ['ID=984621a4-5382-4c35-8a6e-b1485ece36ab,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:13.006589 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device aa09f096-8701-4649-8c74-e8883e55ee7e up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:13.144346 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2256cb26-3c3d-4905-8a87-fb91570a21e5 None None] Network 13c627dc-b4e4-4312-bbc3-d825db999a37 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:02:13.244877 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:13.346706 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c55a64-7171-495c-bbd5-24fa437b4b94 req-3bd6d2ea-0cf8-4a2e-8b3c-a479209a8f1e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:13.348145 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-08c55a64-7171-495c-bbd5-24fa437b4b94 req-3bd6d2ea-0cf8-4a2e-8b3c-a479209a8f1e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0781853 Aug 24 03:02:13.394252 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4912ef97-05eb-45c3-abd1-010bfe5c37e2 None None] Provisioning for port aa09f096-8701-4649-8c74-e8883e55ee7e completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:02:13.399317 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port aa09f096-8701-4649-8c74-e8883e55ee7e completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:02:13.403200 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4912ef97-05eb-45c3-abd1-010bfe5c37e2 None None] Provisioning complete for port aa09f096-8701-4649-8c74-e8883e55ee7e triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:13.405651 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-08c55a64-7171-495c-bbd5-24fa437b4b94 req-92c01c11-a726-4c76-bd63-a86995fa2b1a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469232 Aug 24 03:02:13.406127 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4912ef97-05eb-45c3-abd1-010bfe5c37e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:13.409564 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port aa09f096-8701-4649-8c74-e8883e55ee7e triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:13.409971 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:13.423407 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2173fc0c-fcfd-4a47-907e-d3b79fa2ca7c req-760c38f0-940a-434e-ade2-2c5dca11cc86 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 210 time: 0.0294068 Aug 24 03:02:13.493771 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-560242', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-569595'] for router, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:13.575183 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:13.577078 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4912ef97-05eb-45c3-abd1-010bfe5c37e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:13.623695 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port aa09f096-8701-4649-8c74-e8883e55ee7e, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=aa09f096-8701-4649-8c74-e8883e55ee7e,segment=NetworkSegment(7f24683c-fde3-41b9-a14e-aac1a7e5eb69),segment_id=7f24683c-fde3-41b9-a14e-aac1a7e5eb69)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:13.680779 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:13.681761 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 4b3cf046-5f07-4c52-b229-289330f08157 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:13.707879 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Router 71ad6783-2e04-4eb2-b203-4974f765b8e8 is scheduled to L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 with binding_index 1 {{(pid=111275) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Aug 24 03:02:13.793597 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9478645c-6077-4c06-906a-4a3f3deffd0c req-1217dae9-b718-405d-b846-7671a96fbf7e tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:13.795623 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9478645c-6077-4c06-906a-4a3f3deffd0c req-1217dae9-b718-405d-b846-7671a96fbf7e tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0630198 Aug 24 03:02:13.806420 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.db.api [None req-4912ef97-05eb-45c3-abd1-010bfe5c37e2 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=111277) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Aug 24 03:02:13.806793 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG oslo_db.api [None req-4912ef97-05eb-45c3-abd1-010bfe5c37e2 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Aug 24 03:02:13.811887 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=aa09f096-8701-4649-8c74-e8883e55ee7e,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:13.842343 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9478645c-6077-4c06-906a-4a3f3deffd0c req-159e511f-9611-4d5a-8388-a9b5236cc0d0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406699 Aug 24 03:02:13.891943 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:02:13.901263 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Sync routers for ids ['71ad6783-2e04-4eb2-b203-4974f765b8e8'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:02:13.910066 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Routers {'71ad6783-2e04-4eb2-b203-4974f765b8e8'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:02:13.910664 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:01:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['71ad6783-2e04-4eb2-b203-4974f765b8e8'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:13.930676 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 4b3cf046-5f07-4c52-b229-289330f08157 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:02:13.934672 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 4b3cf046-5f07-4c52-b229-289330f08157 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:13.935049 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:14.010991 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] Notify callbacks [] for router, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:14.015368 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35966) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:14.016460 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-645c11ee-c4a9-40c0-89c1-c6f56b86dfd8 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.9762735 Aug 24 03:02:14.016593 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Set router 71ad6783-2e04-4eb2-b203-4974f765b8e8 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:02:14.032819 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:14.069751 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port 4b3cf046-5f07-4c52-b229-289330f08157, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=4b3cf046-5f07-4c52-b229-289330f08157,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:14.189497 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 35972) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:14.190273 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:14.208614 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'name': 'tempest-TestVolumeBootPattern-99759354-router', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78'}], 'enable_snat': True}, 'gw_port_id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:11Z', 'updated_at': '2021-08-24T03:02:12Z', 'revision_number': 3, 'project_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'gw_port': {'id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:77:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:12Z', 'updated_at': '2021-08-24T03:02:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:14.243819 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Checking router: 71ad6783-2e04-4eb2-b203-4974f765b8e8 for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:02:14.244226 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Updating router 71ad6783-2e04-4eb2-b203-4974f765b8e8 port 984621a4-5382-4c35-8a6e-b1485ece36ab binding host dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:02:14.254327 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=4b3cf046-5f07-4c52-b229-289330f08157,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:14.270069 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:14.336515 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7a6011f7-209d-442f-bd05-aa89c5221b56 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:14.479935 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-d14c111f-7597-47d5-b190-554df9f9d8d9 None None] Provisioning complete for port aa09f096-8701-4649-8c74-e8883e55ee7e triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:14.479935 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-d14c111f-7597-47d5-b190-554df9f9d8d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:14.532842 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Notify callbacks [] for port, precommit_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:14.544455 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.provisioning_blocks [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Transition to ACTIVE for port object 984621a4-5382-4c35-8a6e-b1485ece36ab will not be triggered until provisioned by entity L2. {{(pid=111278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:14.588362 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6509fef3-46fd-478c-8ae2-8c3f4d32e6b2 req-73aa9fb8-9339-4bc4-9e10-e036b0ddfd15 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 210 time: 0.0267873 Aug 24 03:02:14.633931 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:14.687145 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Attempting to bind port 984621a4-5382-4c35-8a6e-b1485ece36ab on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:02:14.687510 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Attempting to bind port 984621a4-5382-4c35-8a6e-b1485ece36ab by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:02:14.687868 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Attempting to bind port 984621a4-5382-4c35-8a6e-b1485ece36ab on network 63097abe-4b2c-457b-a244-629c1feb1fe5 {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:02:14.695958 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 1, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:02:14.696325 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Checking segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:02:14.696717 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:14.698736 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Bound using segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:02:14.698736 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Bound port: 984621a4-5382-4c35-8a6e-b1485ece36ab, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:02:14.698736 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:14.704767 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da976cfb-7163-40a7-9440-3c42a05198e0 None None] Pushing event updated for resources: {'Port': ['ID=984621a4-5382-4c35-8a6e-b1485ece36ab,revision_number=2']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:14.762478 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] For port 984621a4-5382-4c35-8a6e-b1485ece36ab, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:02:14.765782 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] For port 984621a4-5382-4c35-8a6e-b1485ece36ab, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=984621a4-5382-4c35-8a6e-b1485ece36ab,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:02:14.837762 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cea6d2b-be5b-4c30-8a3d-98bc3226f483 req-944b9b40-6fa5-401c-be6e-75d5fa664418 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:14.839519 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3cea6d2b-be5b-4c30-8a3d-98bc3226f483 req-944b9b40-6fa5-401c-be6e-75d5fa664418 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.2067883 Aug 24 03:02:14.878163 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-6c78d952-2581-4d56-bc26-8fedaaeeb9c6 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:14.880590 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-6c78d952-2581-4d56-bc26-8fedaaeeb9c6 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.43 "GET /v2.0/networks?id=f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee HTTP/1.1" status: 200 len: 814 time: 0.2486725 Aug 24 03:02:14.886070 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:14.954374 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Request body: {'port': {'device_id': 'ae293e02-cdd8-4d94-8afd-28b7e52eb07d', 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee', 'admin_state_up': True, 'tenant_id': '3b289da7de434e9ca4c67edc2769c6ab'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:14.982186 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da976cfb-7163-40a7-9440-3c42a05198e0 None None] Pushing event updated for resources: {'Port': ['ID=984621a4-5382-4c35-8a6e-b1485ece36ab,revision_number=3']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:14.994158 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d4261fe-fce1-4020-9807-3b0d26eb4696 req-63864492-70c0-4592-aff3-52336a5751e9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:14.998239 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9d4261fe-fce1-4020-9807-3b0d26eb4696 req-63864492-70c0-4592-aff3-52336a5751e9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0770795 Aug 24 03:02:15.011273 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Routers {'71ad6783-2e04-4eb2-b203-4974f765b8e8'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:02:15.011998 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:01:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['71ad6783-2e04-4eb2-b203-4974f765b8e8'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:15.026412 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device aa09f096-8701-4649-8c74-e8883e55ee7e up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:15.053860 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9d4261fe-fce1-4020-9807-3b0d26eb4696 req-4ce2682f-1e9d-49c0-8627-72edf6845939 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447049 Aug 24 03:02:15.082044 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port aa09f096-8701-4649-8c74-e8883e55ee7e triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:15.082611 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:15.089088 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:15.096740 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3cea6d2b-be5b-4c30-8a3d-98bc3226f483 req-98a94635-4df5-4098-99db-df467280fd50 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2482235 Aug 24 03:02:15.153602 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] Set router 71ad6783-2e04-4eb2-b203-4974f765b8e8 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:02:15.185648 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 4b3cf046-5f07-4c52-b229-289330f08157 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:15.198816 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7a6011f7-209d-442f-bd05-aa89c5221b56 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:15.248211 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 4b3cf046-5f07-4c52-b229-289330f08157 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:15.248730 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:15.333539 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Allocated IP 172.20.0.1 (13c627dc-b4e4-4312-bbc3-d825db999a37/4b7095fd-e503-473e-b61b-354e0711f169/9965b4e1-c80d-431e-9f19-6ebd3262cd07) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:02:15.358836 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'name': 'tempest-TestVolumeBootPattern-99759354-router', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78'}], 'enable_snat': True}, 'gw_port_id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:11Z', 'updated_at': '2021-08-24T03:02:12Z', 'revision_number': 3, 'project_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'gw_port': {'id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:77:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:12Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:15.403112 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7a6011f7-209d-442f-bd05-aa89c5221b56 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:15.467676 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-7a6011f7-209d-442f-bd05-aa89c5221b56 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b0e553da841f482e9fe6565269ad1efb&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2771201 Aug 24 03:02:15.468390 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a6011f7-209d-442f-bd05-aa89c5221b56 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4527bac-7ae1-42ed-90ba-590c722df8e7,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:15.470498 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 35992) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:15.477434 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ed309e9-1a04-41b5-b7d0-6ee971a834cc None None] The sync data for ids ['71ad6783-2e04-4eb2-b203-4974f765b8e8'] in dv-cinder-803748-8-iscsi is: [{'id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'name': 'tempest-TestVolumeBootPattern-99759354-router', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78'}], 'enable_snat': True}, 'gw_port_id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:11Z', 'updated_at': '2021-08-24T03:02:12Z', 'revision_number': 3, 'project_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'gw_port': {'id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:77:0a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:12Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:02:15.509396 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:15.522164 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Made reservation on behalf of 3b289da7de434e9ca4c67edc2769c6ab for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:02:15.525740 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:15.535097 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7d77ff31-d558-45d9-b349-b33013fc334d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:15.535703 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Transition to ACTIVE for port object 9965b4e1-c80d-431e-9f19-6ebd3262cd07 will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:15.564270 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7d77ff31-d558-45d9-b349-b33013fc334d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:15.702881 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f9c085c3-998d-42ff-b652-cf12fef67cfe req-ec76c53f-9275-49bf-9629-06413b6b0610 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 210 time: 0.0406873 Aug 24 03:02:15.708848 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7d77ff31-d558-45d9-b349-b33013fc334d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:15.713529 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7d77ff31-d558-45d9-b349-b33013fc334d admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:15.723503 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-7d77ff31-d558-45d9-b349-b33013fc334d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e4527bac-7ae1-42ed-90ba-590c722df8e7 HTTP/1.1" status: 204 len: 168 time: 0.2433362 Aug 24 03:02:15.727193 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d77ff31-d558-45d9-b349-b33013fc334d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4527bac-7ae1-42ed-90ba-590c722df8e7,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:15.733071 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Allocated IP 172.20.0.3 (f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee/fbe73e0e-d251-4e49-99f9-e952356c2e56/a9477ae9-0c3b-41e5-8ae2-b6d764f9b187) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:02:15.749984 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:15.832523 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Network 13c627dc-b4e4-4312-bbc3-d825db999a37 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:02:15.844397 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:02:15.855250 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:02:15.941190 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Pushing event updated for resources: {'Port': ['ID=9965b4e1-c80d-431e-9f19-6ebd3262cd07,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:16.011272 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-571748'] for router_interface, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:16.168846 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:16.265533 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e607cdf-0813-4b9e-8dbb-73c29b22afc8 req-2ebbdbf8-61b5-41ce-afcb-1895bd6db27d tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:16.267197 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5e607cdf-0813-4b9e-8dbb-73c29b22afc8 req-2ebbdbf8-61b5-41ce-afcb-1895bd6db27d tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0996716 Aug 24 03:02:16.303240 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-009328d0-a6e0-4d92-a12a-1aeae49714de None None] Provisioning for port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:02:16.309902 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-009328d0-a6e0-4d92-a12a-1aeae49714de None None] Provisioning complete for port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:16.310291 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-009328d0-a6e0-4d92-a12a-1aeae49714de None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:16.323159 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64cb9851-040b-4667-917a-6c8de6252c7e req-724c81b4-bac1-4a1e-94db-53d07531b5ea tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:16.329754 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5e607cdf-0813-4b9e-8dbb-73c29b22afc8 req-13bd85e8-efd5-4b44-8dea-249488351d34 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0548129 Aug 24 03:02:16.337653 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-64cb9851-040b-4667-917a-6c8de6252c7e req-724c81b4-bac1-4a1e-94db-53d07531b5ea tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.1038165 Aug 24 03:02:16.395116 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-009328d0-a6e0-4d92-a12a-1aeae49714de None None] Port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:02:16.403047 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:16.420812 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-64cb9851-040b-4667-917a-6c8de6252c7e req-eea2e45f-c198-4921-bc0d-e5b9eee23daf tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879345 Aug 24 03:02:16.459671 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:16.535266 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:02:16.554421 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:02:16.557895 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Pushing event updated for resources: {'Port': ['ID=a9477ae9-0c3b-41e5-8ae2-b6d764f9b187,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:16.560223 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:02:16.667595 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:16.668215 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:16.748420 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:16.790563 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8910b7b-4e99-43a4-801a-ed02a84a1c1c req-7e238435-2aea-401f-b0e2-0e8c99e43517 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:16.792519 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c8910b7b-4e99-43a4-801a-ed02a84a1c1c req-7e238435-2aea-401f-b0e2-0e8c99e43517 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0600648 Aug 24 03:02:16.826394 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e791c754-1df7-4fa8-8699-e4ec4fda8b8a req-2dddf36e-6259-4d5f-bad7-5b89487413af tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:16.827881 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e791c754-1df7-4fa8-8699-e4ec4fda8b8a req-2dddf36e-6259-4d5f-bad7-5b89487413af tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 931 time: 0.0530393 Aug 24 03:02:16.840887 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c8910b7b-4e99-43a4-801a-ed02a84a1c1c req-793b55f2-326c-46be-977c-77b16f6c6252 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396357 Aug 24 03:02:16.868280 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e791c754-1df7-4fa8-8699-e4ec4fda8b8a req-f124d37e-72a4-41d8-8a87-87091b9e69f0 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338223 Aug 24 03:02:16.913067 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:16.925338 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-809ab586-024f-4e2a-9692-4520821c9de9 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.9754758 Aug 24 03:02:16.974568 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Request body: {'port': {'device_id': 'ae293e02-cdd8-4d94-8afd-28b7e52eb07d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:16.985369 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 984621a4-5382-4c35-8a6e-b1485ece36ab up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:17.077682 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Pushing event updated for resources: {'Port': ['ID=9965b4e1-c80d-431e-9f19-6ebd3262cd07,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:17.082063 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-748278', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-571822'] for router_interface, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:17.086925 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:17.107219 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 984621a4-5382-4c35-8a6e-b1485ece36ab completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:02:17.111140 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 984621a4-5382-4c35-8a6e-b1485ece36ab triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:17.111511 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:17.117844 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc529062-8b06-4b99-bdf1-7d5c1c1c6f21 req-079f70e7-4e6a-4f53-bbad-759d10f0cee4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:17.119373 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fc529062-8b06-4b99-bdf1-7d5c1c1c6f21 req-079f70e7-4e6a-4f53-bbad-759d10f0cee4 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 1099 time: 0.1206100 Aug 24 03:02:17.191344 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:17.212387 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port 984621a4-5382-4c35-8a6e-b1485ece36ab, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=984621a4-5382-4c35-8a6e-b1485ece36ab,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:17.342124 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:17.360966 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Network 13c627dc-b4e4-4312-bbc3-d825db999a37 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:02:17.362269 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc529062-8b06-4b99-bdf1-7d5c1c1c6f21 req-b340891a-8f47-4b3f-869e-3f54c5a5637a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:17.363775 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fc529062-8b06-4b99-bdf1-7d5c1c1c6f21 req-b340891a-8f47-4b3f-869e-3f54c5a5637a service neutron] 10.222.0.43 "GET /v2.0/networks?id=f35e751d-f371-4788-abda-6a58b8a779df HTTP/1.1" status: 200 len: 911 time: 0.2008855 Aug 24 03:02:17.369095 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:02:17.399024 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=984621a4-5382-4c35-8a6e-b1485ece36ab,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:17.562218 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fc529062-8b06-4b99-bdf1-7d5c1c1c6f21 req-9050286a-091f-4c28-b50d-31349993ac27 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd HTTP/1.1" status: 200 len: 1002 time: 0.1793513 Aug 24 03:02:17.625375 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-f9bab7de-7e6f-4e6b-a997-31b2e9e655e3 None None] Provisioning complete for port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:17.625790 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-f9bab7de-7e6f-4e6b-a997-31b2e9e655e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:17.672575 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-f9bab7de-7e6f-4e6b-a997-31b2e9e655e3 None None] Port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:02:17.934669 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de8b8e25-d21e-429c-a503-b03623ed2442 req-7f1ab2f3-8526-40fa-a5c7-dad65966a755 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:17.936189 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-de8b8e25-d21e-429c-a503-b03623ed2442 req-7f1ab2f3-8526-40fa-a5c7-dad65966a755 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.4398744 Aug 24 03:02:17.960035 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5373e7cd-7e04-4ccc-85cb-64bfa346cbbc req-92133c20-500f-46a0-96c8-a3407a0a01f4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:17.961625 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5373e7cd-7e04-4ccc-85cb-64bfa346cbbc req-92133c20-500f-46a0-96c8-a3407a0a01f4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0505168 Aug 24 03:02:17.985956 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Router 71ad6783-2e04-4eb2-b203-4974f765b8e8 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:02:17.987553 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc529062-8b06-4b99-bdf1-7d5c1c1c6f21 req-3aa05220-025e-4c5f-a4bb-980e89a02b28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:17.989038 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fc529062-8b06-4b99-bdf1-7d5c1c1c6f21 req-3aa05220-025e-4c5f-a4bb-980e89a02b28 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=14102a94-a55b-43e1-a7a9-4210a4c2e2fb HTTP/1.1" status: 200 len: 849 time: 0.1422830 Aug 24 03:02:18.000230 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5373e7cd-7e04-4ccc-85cb-64bfa346cbbc req-1b43b9b9-6bf3-409b-afe8-a3aee05cdd0c tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325358 Aug 24 03:02:18.033127 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:02:18.051072 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:18.100852 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-de8b8e25-d21e-429c-a503-b03623ed2442 req-5aff93e1-67fe-4d34-af04-899bff9f8e2d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1567600 Aug 24 03:02:18.115025 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Transition to ACTIVE for port object a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:18.116704 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f848dc4-ec4f-4f9e-adc2-9e16753acdf4 req-7ad6677c-1999-48b8-ae7d-b77eabe4f48e tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:18.122237 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4f848dc4-ec4f-4f9e-adc2-9e16753acdf4 req-7ad6677c-1999-48b8-ae7d-b77eabe4f48e tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 931 time: 0.0545001 Aug 24 03:02:18.127382 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc529062-8b06-4b99-bdf1-7d5c1c1c6f21 req-0941fa42-9cfa-43ca-8461-2546da00480d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:18.128873 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fc529062-8b06-4b99-bdf1-7d5c1c1c6f21 req-0941fa42-9cfa-43ca-8461-2546da00480d service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=f35e751d-f371-4788-abda-6a58b8a779df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1295445 Aug 24 03:02:18.163303 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4f848dc4-ec4f-4f9e-adc2-9e16753acdf4 req-36b877c4-3301-4c7e-844e-05a1ee99441d tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366597 Aug 24 03:02:18.230944 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:18.236598 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:02:18.247558 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-126c9a04-085b-4f26-a8c5-eabbc52d0c70 admin admin] 10.222.0.30 "PUT /v2.0/routers/71ad6783-2e04-4eb2-b203-4974f765b8e8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2309806 Aug 24 03:02:18.248137 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Sync routers for ids ['71ad6783-2e04-4eb2-b203-4974f765b8e8'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:02:18.258520 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Routers {'71ad6783-2e04-4eb2-b203-4974f765b8e8'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:02:18.258876 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:01:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['71ad6783-2e04-4eb2-b203-4974f765b8e8'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:18.316138 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Pushing event updated for resources: {'Port': ['ID=a9477ae9-0c3b-41e5-8ae2-b6d764f9b187,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:18.325339 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fc529062-8b06-4b99-bdf1-7d5c1c1c6f21 req-bcf08a96-09e9-4dd2-9d2a-27c397b625fc service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1631167 Aug 24 03:02:18.387684 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Set router 71ad6783-2e04-4eb2-b203-4974f765b8e8 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:02:18.473994 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Attempting to bind port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:02:18.473994 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Attempting to bind port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': '8153f8c3-eca4-496c-bd4f-59ba0022c639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:02:18.473994 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Attempting to bind port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 on network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:02:18.473994 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 on network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:02:18.473994 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Attempting to bind port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 on network f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:02:18.480039 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fc529062-8b06-4b99-bdf1-7d5c1c1c6f21 req-4227676b-a315-4cd6-bb41-27bb010ebedf service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1401308 Aug 24 03:02:18.480752 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 2, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:02:18.481122 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Checking segment: {'id': '8153f8c3-eca4-496c-bd4f-59ba0022c639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:02:18.481627 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Bound using segment: {'id': '8153f8c3-eca4-496c-bd4f-59ba0022c639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:02:18.481911 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Bound port: a9477ae9-0c3b-41e5-8ae2-b6d764f9b187, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8153f8c3-eca4-496c-bd4f-59ba0022c639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 361, 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:02:18.482266 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:18.570669 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] For port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:02:18.574191 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] For port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=a9477ae9-0c3b-41e5-8ae2-b6d764f9b187,segment=NetworkSegment(8153f8c3-eca4-496c-bd4f-59ba0022c639),segment_id=8153f8c3-eca4-496c-bd4f-59ba0022c639)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:02:18.611743 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'name': 'tempest-TestVolumeBootPattern-99759354-router', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78'}], 'enable_snat': True}, 'gw_port_id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:11Z', 'updated_at': '2021-08-24T03:02:16Z', 'revision_number': 4, 'project_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'gw_port': {'id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:77:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:12Z', 'updated_at': '2021-08-24T03:02:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '9965b4e1-c80d-431e-9f19-6ebd3262cd07', 'name': '', 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'mac_address': 'fa:16:3e:cd:b2:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '4b7095fd-e503-473e-b61b-354e0711f169', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:15Z', 'updated_at': '2021-08-24T03:02:16Z', 'revision_number': 2, 'project_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'subnets': [{'id': '4b7095fd-e503-473e-b61b-354e0711f169', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:18.639248 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Checking router: 71ad6783-2e04-4eb2-b203-4974f765b8e8 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:02:18.639248 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Updating router 71ad6783-2e04-4eb2-b203-4974f765b8e8 port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 binding host dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:02:18.667698 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:18.685454 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:18.723134 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:18.724527 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:18.726173 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] 10.222.0.43 "PUT /v2.0/ports/a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 HTTP/1.1" status: 200 len: 1093 time: 1.7746596 Aug 24 03:02:18.726627 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae293e02-cdd8-4d94-8afd-28b7e52eb07d', 'tag': 'a9477ae9-0c3b-41e5-8ae2-b6d764f9b187'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:02:18.728886 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9316fff0-26d6-4260-b6a1-c085b0be2c88" -d '{"events": [{"name": "network-changed", "server_uuid": "ae293e02-cdd8-4d94-8afd-28b7e52eb07d", "tag": "a9477ae9-0c3b-41e5-8ae2-b6d764f9b187"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:02:18.758673 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcf12e8c-b8ee-4d9b-b071-18b3175ae9d9 service neutron] Pushing event updated for resources: {'Port': ['ID=a9477ae9-0c3b-41e5-8ae2-b6d764f9b187,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:18.786714 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:02:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a787fa74-a759-4862-9ae4-006f40a4cda1 x-openstack-request-id: req-a787fa74-a759-4862-9ae4-006f40a4cda1 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:02:18.786714 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae293e02-cdd8-4d94-8afd-28b7e52eb07d", "tag": "a9477ae9-0c3b-41e5-8ae2-b6d764f9b187", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:02:18.786714 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-a787fa74-a759-4862-9ae4-006f40a4cda1 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:02:18.786714 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae293e02-cdd8-4d94-8afd-28b7e52eb07d', 'tag': 'a9477ae9-0c3b-41e5-8ae2-b6d764f9b187', 'status': 'completed', 'code': 200} Aug 24 03:02:18.852108 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9316fff0-26d6-4260-b6a1-c085b0be2c88 req-9864134c-9b2b-4fc6-bd64-6ca7bc9e7298 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:18.853683 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9316fff0-26d6-4260-b6a1-c085b0be2c88 req-9864134c-9b2b-4fc6-bd64-6ca7bc9e7298 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=3b289da7de434e9ca4c67edc2769c6ab&device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 1096 time: 0.0478177 Aug 24 03:02:18.964345 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 36034) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:18.968456 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 984621a4-5382-4c35-8a6e-b1485ece36ab up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:18.969938 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-bae66f78-80ac-42b2-8e10-ffa987f17615 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1453650260', 'description': 'tempest-secgroup-smoke-1453650260 description', 'project_id': '03198f839b864099b1c011c0fc54c7dd'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:18.977885 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9316fff0-26d6-4260-b6a1-c085b0be2c88 req-4220976d-aff3-4a1a-9065-476ff88a61ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:18.979222 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9316fff0-26d6-4260-b6a1-c085b0be2c88 req-4220976d-aff3-4a1a-9065-476ff88a61ab service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=3b289da7de434e9ca4c67edc2769c6ab&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1123443 Aug 24 03:02:18.982304 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Notify callbacks [] for port, precommit_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.013088 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Transition to ACTIVE for port object 9965b4e1-c80d-431e-9f19-6ebd3262cd07 will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:19.035615 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 984621a4-5382-4c35-8a6e-b1485ece36ab triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:19.036512 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.057707 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bae66f78-80ac-42b2-8e10-ffa987f17615 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.085953 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.096818 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9316fff0-26d6-4260-b6a1-c085b0be2c88 req-d974a4fa-a465-45f8-bdc3-0555ad984577 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:19.098825 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9316fff0-26d6-4260-b6a1-c085b0be2c88 req-d974a4fa-a465-45f8-bdc3-0555ad984577 service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1102912 Aug 24 03:02:19.170639 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bcba279-e631-4226-9673-53354799a197 req-27c098d2-1d87-4410-97d5-66e5e24f13b5 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:19.172830 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5bcba279-e631-4226-9673-53354799a197 req-27c098d2-1d87-4410-97d5-66e5e24f13b5 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0922673 Aug 24 03:02:19.232902 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-f89262a0-8632-4c78-b638-5045f6a8dc9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:19.235985 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-f89262a0-8632-4c78-b638-5045f6a8dc9b service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=3b289da7de434e9ca4c67edc2769c6ab&device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 1096 time: 0.0736599 Aug 24 03:02:19.256092 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5bcba279-e631-4226-9673-53354799a197 req-7bb046bb-0db9-4bba-8f44-b56a419c1703 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0704916 Aug 24 03:02:19.288084 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bae66f78-80ac-42b2-8e10-ffa987f17615 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.308975 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18da6dc4-8bb9-4e41-acd2-30fa82c205e4 None None] Pushing event updated for resources: {'Port': ['ID=9965b4e1-c80d-431e-9f19-6ebd3262cd07,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:19.325907 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-1f926c94-7dcb-4a2d-b926-159b422565d8 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 HTTP/1.1" status: 200 len: 217 time: 0.0710335 Aug 24 03:02:19.354959 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Attempting to bind port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:02:19.355338 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Attempting to bind port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '7f24683c-fde3-41b9-a14e-aac1a7e5eb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:02:19.355698 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Attempting to bind port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 on network 13c627dc-b4e4-4312-bbc3-d825db999a37 {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:02:19.356457 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb418a1-72ee-4745-aaa1-47fc6fcef035 req-91473a14-c907-4de7-aa74-591a4665d21e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:19.358324 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0fb418a1-72ee-4745-aaa1-47fc6fcef035 req-91473a14-c907-4de7-aa74-591a4665d21e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.1387463 Aug 24 03:02:19.371210 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 1, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:02:19.371605 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Checking segment: {'id': '7f24683c-fde3-41b9-a14e-aac1a7e5eb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:02:19.372042 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.372441 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Bound using segment: {'id': '7f24683c-fde3-41b9-a14e-aac1a7e5eb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:02:19.372924 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Bound port: 9965b4e1-c80d-431e-9f19-6ebd3262cd07, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7f24683c-fde3-41b9-a14e-aac1a7e5eb69', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 365, 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:02:19.373314 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.400459 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bae66f78-80ac-42b2-8e10-ffa987f17615 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.425635 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e83139f-1bbb-4cc4-b3cb-d9ccdb5a1f82 req-80340602-3b1e-461b-9519-34862f14aaa3 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:19.433714 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5e83139f-1bbb-4cc4-b3cb-d9ccdb5a1f82 req-80340602-3b1e-461b-9519-34862f14aaa3 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 943 time: 0.0866814 Aug 24 03:02:19.469651 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0fb418a1-72ee-4745-aaa1-47fc6fcef035 req-236e1828-ac12-4aab-b616-2021ff744362 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0825670 Aug 24 03:02:19.471141 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] For port 9965b4e1-c80d-431e-9f19-6ebd3262cd07, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:02:19.471633 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-026b0b2f-8c8a-4d7b-a687-aa59d1bc1ab9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:19.472715 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-026b0b2f-8c8a-4d7b-a687-aa59d1bc1ab9 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=fbe73e0e-d251-4e49-99f9-e952356c2e56 HTTP/1.1" status: 200 len: 854 time: 0.1380496 Aug 24 03:02:19.477684 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] For port 9965b4e1-c80d-431e-9f19-6ebd3262cd07, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=9965b4e1-c80d-431e-9f19-6ebd3262cd07,segment=NetworkSegment(7f24683c-fde3-41b9-a14e-aac1a7e5eb69),segment_id=7f24683c-fde3-41b9-a14e-aac1a7e5eb69)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:02:19.479110 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bae66f78-80ac-42b2-8e10-ffa987f17615 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b69cad14-2388-40cc-8cc6-0b7d617b183d,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:19.508269 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5e83139f-1bbb-4cc4-b3cb-d9ccdb5a1f82 req-e1a908ec-184e-416b-ab0c-416d17137270 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734892 Aug 24 03:02:19.513844 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bae66f78-80ac-42b2-8e10-ffa987f17615 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.519689 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-bae66f78-80ac-42b2-8e10-ffa987f17615 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.5530925 Aug 24 03:02:19.519939 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-98087113-c8b9-4d7b-81c5-1acc55fb4f8b service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0299606 Aug 24 03:02:19.522853 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 36044) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:19.526527 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-e20bce78-c5dc-4c5a-92b0-bd47194021e5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'security_group_rule': {'security_group_id': 'b69cad14-2388-40cc-8cc6-0b7d617b183d', 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:19.543036 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.613916 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Routers {'71ad6783-2e04-4eb2-b203-4974f765b8e8'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:02:19.614590 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:01:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['71ad6783-2e04-4eb2-b203-4974f765b8e8'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:19.629236 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e20bce78-c5dc-4c5a-92b0-bd47194021e5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.637067 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-4efd88ff-bba8-4955-8e00-4b3bd8130a29 service neutron] 10.222.0.43 "GET /v2.0/networks/f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1013689 Aug 24 03:02:19.668195 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18da6dc4-8bb9-4e41-acd2-30fa82c205e4 None None] Pushing event updated for resources: {'Port': ['ID=9965b4e1-c80d-431e-9f19-6ebd3262cd07,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:19.703988 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e20bce78-c5dc-4c5a-92b0-bd47194021e5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.743932 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b6cad99-946c-4b44-b58d-d7b94ad9065a req-4e389717-d3c3-4188-b6fc-9c09d416b358 service neutron] 10.222.0.43 "GET /v2.0/networks/f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0994072 Aug 24 03:02:19.757672 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] Set router 71ad6783-2e04-4eb2-b203-4974f765b8e8 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:02:19.794340 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e20bce78-c5dc-4c5a-92b0-bd47194021e5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.814025 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e20bce78-c5dc-4c5a-92b0-bd47194021e5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=63335b99-7d32-49d2-9066-9c226c42d641,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:19.909064 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e20bce78-c5dc-4c5a-92b0-bd47194021e5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:19.910311 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-e20bce78-c5dc-4c5a-92b0-bd47194021e5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3878345 Aug 24 03:02:19.913318 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 36048) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:19.917860 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-31b89e77-2ebf-4aee-b602-f61affd2aed5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'security_group_rule': {'security_group_id': 'b69cad14-2388-40cc-8cc6-0b7d617b183d', 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:19.978966 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'name': 'tempest-TestVolumeBootPattern-99759354-router', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78'}], 'enable_snat': True}, 'gw_port_id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:11Z', 'updated_at': '2021-08-24T03:02:16Z', 'revision_number': 4, 'project_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'gw_port': {'id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:77:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:12Z', 'updated_at': '2021-08-24T03:02:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '9965b4e1-c80d-431e-9f19-6ebd3262cd07', 'name': '', 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'mac_address': 'fa:16:3e:cd:b2:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '4b7095fd-e503-473e-b61b-354e0711f169', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:15Z', 'updated_at': '2021-08-24T03:02:19Z', 'revision_number': 4, 'project_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'subnets': [{'id': '4b7095fd-e503-473e-b61b-354e0711f169', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:02:20.004783 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17953505-7d4d-4a05-90d8-620c03b463d5 None None] The sync data for ids ['71ad6783-2e04-4eb2-b203-4974f765b8e8'] in dv-cinder-803748-8-iscsi is: [{'id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'name': 'tempest-TestVolumeBootPattern-99759354-router', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78'}], 'enable_snat': True}, 'gw_port_id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:11Z', 'updated_at': '2021-08-24T03:02:16Z', 'revision_number': 4, 'project_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'gw_port': {'id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:77:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:12Z', 'updated_at': '2021-08-24T03:02:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '9965b4e1-c80d-431e-9f19-6ebd3262cd07', 'name': '', 'network_id': '13c627dc-b4e4-4312-bbc3-d825db999a37', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'mac_address': 'fa:16:3e:cd:b2:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'device_owner': 'network:router_interface', 'standard_attr_id': 397, 'fixed_ips': [{'subnet_id': '4b7095fd-e503-473e-b61b-354e0711f169', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:15Z', 'updated_at': '2021-08-24T03:02:19Z', 'revision_number': 4, 'project_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'subnets': [{'id': '4b7095fd-e503-473e-b61b-354e0711f169', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:02:20.011931 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-31b89e77-2ebf-4aee-b602-f61affd2aed5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:20.079642 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-31b89e77-2ebf-4aee-b602-f61affd2aed5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:20.221149 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-31b89e77-2ebf-4aee-b602-f61affd2aed5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:20.243446 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31b89e77-2ebf-4aee-b602-f61affd2aed5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=290da666-cdce-43b5-aed4-7296110c2b35,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:20.382694 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bb05d89-e65a-4f3b-b3aa-b9acd41acc98 req-6e515048-6597-48b4-ae00-46b2f1063717 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:20.384293 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7bb05d89-e65a-4f3b-b3aa-b9acd41acc98 req-6e515048-6597-48b4-ae00-46b2f1063717 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0522320 Aug 24 03:02:20.425338 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7bb05d89-e65a-4f3b-b3aa-b9acd41acc98 req-1f3d04f1-dac3-48d0-aaa9-a68ec638460c tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0345011 Aug 24 03:02:20.502244 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-31b89e77-2ebf-4aee-b602-f61affd2aed5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:20.503472 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-31b89e77-2ebf-4aee-b602-f61affd2aed5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5891705 Aug 24 03:02:20.506474 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 36060) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:20.540501 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-209d9575-db14-410d-8cbb-a72249502d2e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'security_group_rule': {'security_group_id': 'b69cad14-2388-40cc-8cc6-0b7d617b183d', 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:20.604573 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdf23543-ecee-4d56-904a-df4dd2e0f3d2 req-bc0354de-b304-4985-b9ec-f5b7ad8bf7cb tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:20.606284 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fdf23543-ecee-4d56-904a-df4dd2e0f3d2 req-bc0354de-b304-4985-b9ec-f5b7ad8bf7cb tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0594985 Aug 24 03:02:20.652587 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fdf23543-ecee-4d56-904a-df4dd2e0f3d2 req-35d8253e-897f-4bfb-8a72-1c9bf1665f3b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398452 Aug 24 03:02:20.662318 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-209d9575-db14-410d-8cbb-a72249502d2e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:20.731756 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-209d9575-db14-410d-8cbb-a72249502d2e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:20.822646 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-209d9575-db14-410d-8cbb-a72249502d2e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:20.844520 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-209d9575-db14-410d-8cbb-a72249502d2e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fdcb1e66-4586-4175-9ae9-105c66318c99,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:20.897087 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-209d9575-db14-410d-8cbb-a72249502d2e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:20.901081 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-209d9575-db14-410d-8cbb-a72249502d2e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3910220 Aug 24 03:02:20.901497 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 36068) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:20.906497 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-7a5dba6b-e3f3-4c26-8115-05ed8ed25ef7 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'security_group_rule': {'security_group_id': 'b69cad14-2388-40cc-8cc6-0b7d617b183d', 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:20.945789 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-870bdd68-1aae-4cf9-a733-25ebf8f235a4 req-ffce4423-40ae-4a79-81eb-4a42654c2b97 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:20.947327 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-870bdd68-1aae-4cf9-a733-25ebf8f235a4 req-ffce4423-40ae-4a79-81eb-4a42654c2b97 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 943 time: 0.0773137 Aug 24 03:02:20.988340 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-870bdd68-1aae-4cf9-a733-25ebf8f235a4 req-36e6be6b-a490-401f-966c-0c2955b5a122 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0346558 Aug 24 03:02:21.000622 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 9965b4e1-c80d-431e-9f19-6ebd3262cd07 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:21.038986 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7a5dba6b-e3f3-4c26-8115-05ed8ed25ef7 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.098552 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7a5dba6b-e3f3-4c26-8115-05ed8ed25ef7 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.136420 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:02:21.140847 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:21.141234 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.182544 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7a5dba6b-e3f3-4c26-8115-05ed8ed25ef7 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.191647 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2be65e60-45c1-4f59-8e9a-2b020fbcd3ed req-00e54e63-27c0-4039-9619-e5eb1e02dff0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:21.194339 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2be65e60-45c1-4f59-8e9a-2b020fbcd3ed req-00e54e63-27c0-4039-9619-e5eb1e02dff0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0496635 Aug 24 03:02:21.201398 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a5dba6b-e3f3-4c26-8115-05ed8ed25ef7 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b524328c-a08b-4240-b269-5e45de0be351,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:21.227813 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.243716 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2be65e60-45c1-4f59-8e9a-2b020fbcd3ed req-979e201c-46bd-466b-9076-7b48f73deb49 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0373943 Aug 24 03:02:21.268114 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port 9965b4e1-c80d-431e-9f19-6ebd3262cd07, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=9965b4e1-c80d-431e-9f19-6ebd3262cd07,segment=NetworkSegment(7f24683c-fde3-41b9-a14e-aac1a7e5eb69),segment_id=7f24683c-fde3-41b9-a14e-aac1a7e5eb69)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:21.342415 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7a5dba6b-e3f3-4c26-8115-05ed8ed25ef7 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.343655 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-7a5dba6b-e3f3-4c26-8115-05ed8ed25ef7 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4410343 Aug 24 03:02:21.346296 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 36076) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:21.350638 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-ada0b11a-f8c4-4a8c-8f07-f6b587c4951b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'security_group_rule': {'security_group_id': 'b69cad14-2388-40cc-8cc6-0b7d617b183d', 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:21.399418 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.429372 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-ebbe314c-3877-4c7f-9fde-4e62ba1ed00e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.451726 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=9965b4e1-c80d-431e-9f19-6ebd3262cd07,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:21.485297 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.securitygroups_db [None req-ada0b11a-f8c4-4a8c-8f07-f6b587c4951b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Project 03198f839b864099b1c011c0fc54c7dd added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Aug 24 03:02:21.491198 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ada0b11a-f8c4-4a8c-8f07-f6b587c4951b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.548460 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ada0b11a-f8c4-4a8c-8f07-f6b587c4951b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.627924 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ada0b11a-f8c4-4a8c-8f07-f6b587c4951b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.646407 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ada0b11a-f8c4-4a8c-8f07-f6b587c4951b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=afb25931-21f0-45ed-b34f-e76d9556f37d,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:21.742010 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ada0b11a-f8c4-4a8c-8f07-f6b587c4951b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.745931 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-ada0b11a-f8c4-4a8c-8f07-f6b587c4951b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3960478 Aug 24 03:02:21.750275 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 36080) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:02:21.751533 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-858ac51e-954d-4d6e-9938-1ca40c62b90a tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'security_group_rule': {'security_group_id': 'b69cad14-2388-40cc-8cc6-0b7d617b183d', 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:21.785821 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe3046d-3937-41e6-ac0d-e3ca6888da02 req-d6b5bf41-a802-40c8-9b67-9c950ff0ca4d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:21.788079 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ebe3046d-3937-41e6-ac0d-e3ca6888da02 req-d6b5bf41-a802-40c8-9b67-9c950ff0ca4d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0627880 Aug 24 03:02:21.826781 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ebe3046d-3937-41e6-ac0d-e3ca6888da02 req-61034caf-591b-406f-965a-53bcf4bb503a tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324500 Aug 24 03:02:21.845472 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.securitygroups_db [None req-858ac51e-954d-4d6e-9938-1ca40c62b90a tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Project 03198f839b864099b1c011c0fc54c7dd added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Aug 24 03:02:21.852403 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-858ac51e-954d-4d6e-9938-1ca40c62b90a tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.908604 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-858ac51e-954d-4d6e-9938-1ca40c62b90a tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:21.991307 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:02:22.011032 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-858ac51e-954d-4d6e-9938-1ca40c62b90a tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:22.029712 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-858ac51e-954d-4d6e-9938-1ca40c62b90a tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c684c9d4-8a19-43a8-bc0f-ecb53f16b8fd,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:22.089919 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=a9477ae9-0c3b-41e5-8ae2-b6d764f9b187,segment=NetworkSegment(8153f8c3-eca4-496c-bd4f-59ba0022c639),segment_id=8153f8c3-eca4-496c-bd4f-59ba0022c639)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:22.101489 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': 'a9477ae9-0c3b-41e5-8ae2-b6d764f9b187', 'network_id': 'f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee', 'port_id': 'a9477ae9-0c3b-41e5-8ae2-b6d764f9b187', 'mac_address': 'fa:16:3e:b9:51:c2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 361, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fbe73e0e-d251-4e49-99f9-e952356c2e56', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:02:22.114773 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ddb1ed-fd34-4f9e-8ea9-c8432a9d6a61 req-4fa7443d-4479-4659-9b92-6bba495e0513 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:22.115984 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-80ddb1ed-fd34-4f9e-8ea9-c8432a9d6a61 req-4fa7443d-4479-4659-9b92-6bba495e0513 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 943 time: 0.0495908 Aug 24 03:02:22.117403 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-858ac51e-954d-4d6e-9938-1ca40c62b90a tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:22.117954 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-858ac51e-954d-4d6e-9938-1ca40c62b90a tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3706825 Aug 24 03:02:22.143398 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:22.159012 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:02:22.165766 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-80ddb1ed-fd34-4f9e-8ea9-c8432a9d6a61 req-b17c58d9-cc58-4f85-81bd-f70967631c5d tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399857 Aug 24 03:02:22.183251 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=a9477ae9-0c3b-41e5-8ae2-b6d764f9b187,segment=NetworkSegment(8153f8c3-eca4-496c-bd4f-59ba0022c639),segment_id=8153f8c3-eca4-496c-bd4f-59ba0022c639)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:22.268195 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:22.336369 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=a9477ae9-0c3b-41e5-8ae2-b6d764f9b187,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:22.385357 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e699101e-b5d4-43c1-8deb-690942a5d554 req-0ba2ac1c-1c33-46e2-a22d-2529fb2c09b7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:22.386909 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e699101e-b5d4-43c1-8deb-690942a5d554 req-0ba2ac1c-1c33-46e2-a22d-2529fb2c09b7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0583918 Aug 24 03:02:22.438729 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e699101e-b5d4-43c1-8deb-690942a5d554 req-1b93a171-59da-44fa-9dfa-752e97d6abae tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0456898 Aug 24 03:02:22.564884 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['a9477ae9-0c3b-41e5-8ae2-b6d764f9b187'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:02:22.960537 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5058e4-8d4c-4777-8c6c-fed7fde39f55 req-e553b863-8e07-4f3b-9df6-e2c264f0e48f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:22.960537 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2c5058e4-8d4c-4777-8c6c-fed7fde39f55 req-e553b863-8e07-4f3b-9df6-e2c264f0e48f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0560730 Aug 24 03:02:22.961478 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 9965b4e1-c80d-431e-9f19-6ebd3262cd07 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:23.002192 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2c5058e4-8d4c-4777-8c6c-fed7fde39f55 req-ad40f32b-60fa-4df7-9be9-e53944bc3982 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373979 Aug 24 03:02:23.013505 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:23.013941 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:23.277100 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2556117-e800-4c0b-9d4d-0092e1f7c9ac req-06b8f604-2187-4e89-9edb-c429394fda6e tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:23.278587 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f2556117-e800-4c0b-9d4d-0092e1f7c9ac req-06b8f604-2187-4e89-9edb-c429394fda6e tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 944 time: 0.0469763 Aug 24 03:02:23.318601 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f2556117-e800-4c0b-9d4d-0092e1f7c9ac req-e9ce7c3e-4dad-4fed-89ce-b885a29b1d49 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340221 Aug 24 03:02:23.562141 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e5d1ade-c1cd-4d3b-855f-9880fd10f17f req-bf06ed01-4df1-4519-89cb-54586541d1b8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:23.563486 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4e5d1ade-c1cd-4d3b-855f-9880fd10f17f req-bf06ed01-4df1-4519-89cb-54586541d1b8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0532186 Aug 24 03:02:23.600633 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4e5d1ade-c1cd-4d3b-855f-9880fd10f17f req-8f1035cf-9ea4-4cd1-90a8-5190bd96e9e9 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0310245 Aug 24 03:02:24.018091 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:24.121458 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db66ea6c-1f34-4fb2-80f7-6bb040b384ce req-3e9456e6-5a84-4e49-bea1-a79be777da6e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:24.123299 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-db66ea6c-1f34-4fb2-80f7-6bb040b384ce req-3e9456e6-5a84-4e49-bea1-a79be777da6e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0511131 Aug 24 03:02:24.125556 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5c5adec7-7cbd-4356-ba34-745fc67dd953 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:24.158170 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:02:24.162043 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-db66ea6c-1f34-4fb2-80f7-6bb040b384ce req-6f3b19a1-e8c8-4bac-870f-025304ed6f92 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322695 Aug 24 03:02:24.163033 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:24.163492 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:24.243746 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:24.280792 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae293e02-cdd8-4d94-8afd-28b7e52eb07d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a9477ae9-0c3b-41e5-8ae2-b6d764f9b187'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:02:24.283067 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df0f6371-96ec-4af9-aced-79fdc9da0c22" -d '{"events": [{"server_uuid": "ae293e02-cdd8-4d94-8afd-28b7e52eb07d", "name": "network-vif-plugged", "status": "completed", "tag": "a9477ae9-0c3b-41e5-8ae2-b6d764f9b187"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:02:24.302164 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=a9477ae9-0c3b-41e5-8ae2-b6d764f9b187,segment=NetworkSegment(8153f8c3-eca4-496c-bd4f-59ba0022c639),segment_id=8153f8c3-eca4-496c-bd4f-59ba0022c639)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:24.326667 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:02:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f845e6bb-3b5e-436d-aa46-cd8e9b89c11a x-openstack-request-id: req-f845e6bb-3b5e-436d-aa46-cd8e9b89c11a {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:02:24.326962 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae293e02-cdd8-4d94-8afd-28b7e52eb07d", "name": "network-vif-plugged", "status": "completed", "tag": "a9477ae9-0c3b-41e5-8ae2-b6d764f9b187", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:02:24.327984 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f845e6bb-3b5e-436d-aa46-cd8e9b89c11a {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:02:24.327984 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae293e02-cdd8-4d94-8afd-28b7e52eb07d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a9477ae9-0c3b-41e5-8ae2-b6d764f9b187', 'code': 200} Aug 24 03:02:24.377895 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:24.405020 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:24.446791 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ed4a51-e518-4639-ae60-1aff42721ed8 req-be8ea55f-56c3-451f-ae79-791671c2d3c1 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:24.449865 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-12ed4a51-e518-4639-ae60-1aff42721ed8 req-be8ea55f-56c3-451f-ae79-791671c2d3c1 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 945 time: 0.0551074 Aug 24 03:02:24.461090 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=a9477ae9-0c3b-41e5-8ae2-b6d764f9b187,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:24.488379 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-12ed4a51-e518-4639-ae60-1aff42721ed8 req-455c5869-189c-4108-9c3c-9f8a91d43f1b tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330136 Aug 24 03:02:24.653432 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d124b6-cbdd-4afc-8705-54d9823de036 req-6d75c734-6417-41dc-a585-6221e9084117 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:24.655025 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-09d124b6-cbdd-4afc-8705-54d9823de036 req-6d75c734-6417-41dc-a585-6221e9084117 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 1098 time: 0.0457783 Aug 24 03:02:24.717332 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-09d124b6-cbdd-4afc-8705-54d9823de036 req-4184adfb-0332-4ba2-bc30-be9062a1b96b service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0550878 Aug 24 03:02:24.735165 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88159c58-e969-4cfb-b2f1-611558be6568 req-7e6a2e83-1ed6-4465-a1c0-6bb1023f2995 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:24.736622 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-88159c58-e969-4cfb-b2f1-611558be6568 req-7e6a2e83-1ed6-4465-a1c0-6bb1023f2995 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0589690 Aug 24 03:02:24.774444 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-88159c58-e969-4cfb-b2f1-611558be6568 req-08f40255-a9ba-44c2-a2d0-5d3a24b3cfec tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0318472 Aug 24 03:02:25.277447 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f76683b-ab36-42c4-89b7-dfc948fd4463 req-3ea26b74-c545-413b-ba61-4f540e738c4e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:25.278992 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1f76683b-ab36-42c4-89b7-dfc948fd4463 req-3ea26b74-c545-413b-ba61-4f540e738c4e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0496924 Aug 24 03:02:25.316488 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1f76683b-ab36-42c4-89b7-dfc948fd4463 req-16e628d8-c372-4ee3-bbe7-160f30bb34de tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316377 Aug 24 03:02:25.587832 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:25.610221 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d823f8c-6f01-4551-b15d-83599c48f000 req-9975082c-b973-45ae-bd80-534cb63f9f2a tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:25.611767 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d823f8c-6f01-4551-b15d-83599c48f000 req-9975082c-b973-45ae-bd80-534cb63f9f2a tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 945 time: 0.0520873 Aug 24 03:02:25.650814 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d823f8c-6f01-4551-b15d-83599c48f000 req-b4441de3-c978-4a9b-9825-ab9ec1efb042 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319252 Aug 24 03:02:25.896614 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73366391-b664-4a85-8e87-b4a60e822574 req-4c318e0a-6874-4bde-99f8-a373d0257a05 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:25.898155 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-73366391-b664-4a85-8e87-b4a60e822574 req-4c318e0a-6874-4bde-99f8-a373d0257a05 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0506153 Aug 24 03:02:25.936943 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-73366391-b664-4a85-8e87-b4a60e822574 req-7a89d029-a9b2-4d1d-8838-408e56015b09 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0328619 Aug 24 03:02:26.434942 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c58e5e-d6db-49e0-ae95-e098f4bae0d2 req-42010bbf-bf33-4ecd-99f7-e220af6173d0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:26.437244 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-48c58e5e-d6db-49e0-ae95-e098f4bae0d2 req-42010bbf-bf33-4ecd-99f7-e220af6173d0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0526407 Aug 24 03:02:26.475737 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-48c58e5e-d6db-49e0-ae95-e098f4bae0d2 req-f6864865-b2e9-40de-9ec3-53a13bedf08d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310900 Aug 24 03:02:26.770317 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c89590c-10b0-4967-8783-289cac651907 req-6a49f842-543a-46d0-9856-873d9020e7da tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:26.771885 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3c89590c-10b0-4967-8783-289cac651907 req-6a49f842-543a-46d0-9856-873d9020e7da tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 945 time: 0.0529177 Aug 24 03:02:26.809109 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3c89590c-10b0-4967-8783-289cac651907 req-3af9b214-f9e0-450e-9677-1e6074adce49 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313120 Aug 24 03:02:26.988051 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:27.063152 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e47dfb0-a2f1-455d-a7a7-12ff352ca5d0 req-e4054f22-b57e-487a-af35-b90d40294e6d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:27.064609 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4e47dfb0-a2f1-455d-a7a7-12ff352ca5d0 req-e4054f22-b57e-487a-af35-b90d40294e6d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0515256 Aug 24 03:02:27.102417 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4e47dfb0-a2f1-455d-a7a7-12ff352ca5d0 req-42f47916-82bf-4ed9-8af0-045af2720786 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0308704 Aug 24 03:02:27.591149 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53be117d-76eb-4197-b549-a7296e9f1d40 req-96ce7580-3e58-46be-8f65-a63915540e1c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:27.592606 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-53be117d-76eb-4197-b549-a7296e9f1d40 req-96ce7580-3e58-46be-8f65-a63915540e1c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0480735 Aug 24 03:02:27.632043 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-53be117d-76eb-4197-b549-a7296e9f1d40 req-83a82c75-8252-48df-898a-309fbc77bd2c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330448 Aug 24 03:02:27.878634 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fa0fabe-8056-49e6-bf30-f8eebbb5d94f req-f24389e6-05ac-41a1-b379-4322181365ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:27.880447 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1fa0fabe-8056-49e6-bf30-f8eebbb5d94f req-f24389e6-05ac-41a1-b379-4322181365ba service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 1098 time: 0.0414021 Aug 24 03:02:27.915330 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1fa0fabe-8056-49e6-bf30-f8eebbb5d94f req-767061fa-b13b-49e8-a9c3-5b82389b344b service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0274510 Aug 24 03:02:28.225952 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b5691c4-c41e-40f2-9677-e677e81ee7cd req-c1cbdad8-1309-4b7e-944c-7a1bbe7d8760 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:28.227559 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5b5691c4-c41e-40f2-9677-e677e81ee7cd req-c1cbdad8-1309-4b7e-944c-7a1bbe7d8760 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0534940 Aug 24 03:02:28.270973 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5b5691c4-c41e-40f2-9677-e677e81ee7cd req-04f22a36-614f-47a6-99e5-fc80153bd53d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0373240 Aug 24 03:02:28.754943 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-355cf2e0-d69d-4882-b270-f77cb97d1947 req-9de07dca-9939-4509-94d2-35501520c32f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:28.756397 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-355cf2e0-d69d-4882-b270-f77cb97d1947 req-9de07dca-9939-4509-94d2-35501520c32f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0513177 Aug 24 03:02:28.794909 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-355cf2e0-d69d-4882-b270-f77cb97d1947 req-6e3fed24-a296-4fca-bce1-c97c14a2e44e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322816 Aug 24 03:02:29.392669 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c16d3a5-5f9e-4cb1-af43-ebd509f2e4f8 req-b8e3f1af-f5cf-44d0-8a98-4b9164d0db16 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:29.394171 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0c16d3a5-5f9e-4cb1-af43-ebd509f2e4f8 req-b8e3f1af-f5cf-44d0-8a98-4b9164d0db16 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0489731 Aug 24 03:02:29.432630 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0c16d3a5-5f9e-4cb1-af43-ebd509f2e4f8 req-6276fc35-e6ef-4825-abc2-610fa1929463 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0317922 Aug 24 03:02:29.909780 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a511507a-d4b8-42f2-9fef-ceb063045228 req-71f245e4-c61f-4438-b81f-65117a4d916c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:29.912047 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a511507a-d4b8-42f2-9fef-ceb063045228 req-71f245e4-c61f-4438-b81f-65117a4d916c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0481403 Aug 24 03:02:29.950768 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a511507a-d4b8-42f2-9fef-ceb063045228 req-3b58a723-dcb9-4fab-8402-60bb924bb6fa tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321460 Aug 24 03:02:30.489504 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1345dff0-a2b8-407c-94d4-12ac153567b1 req-24181a3b-2703-4ad8-84ec-cf00ca6dd28d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:30.495471 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1345dff0-a2b8-407c-94d4-12ac153567b1 req-24181a3b-2703-4ad8-84ec-cf00ca6dd28d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0502727 Aug 24 03:02:30.531866 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1345dff0-a2b8-407c-94d4-12ac153567b1 req-b6a82bb7-5df1-46c5-a563-61c3268ac7dd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332410 Aug 24 03:02:30.575804 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d947cb9-dc45-495c-a93c-f9c70955a7ae req-dd5ad92b-bd20-47d8-a983-9b06d6bd9744 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:30.577203 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d947cb9-dc45-495c-a93c-f9c70955a7ae req-dd5ad92b-bd20-47d8-a983-9b06d6bd9744 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 1098 time: 0.0722353 Aug 24 03:02:30.591047 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-352d5906-fe87-4387-a7ca-c9245ea4bad7 req-e913fc5c-4ef6-4fcc-9a1b-d3e545848ce0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:30.592407 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-352d5906-fe87-4387-a7ca-c9245ea4bad7 req-e913fc5c-4ef6-4fcc-9a1b-d3e545848ce0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0634363 Aug 24 03:02:30.675919 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-352d5906-fe87-4387-a7ca-c9245ea4bad7 req-8680b4d6-6192-44db-b3d2-48e9396b59c6 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0753803 Aug 24 03:02:30.702883 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d947cb9-dc45-495c-a93c-f9c70955a7ae req-6a89eb9f-e860-4829-9a56-6e17c61ac7f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:30.704348 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d947cb9-dc45-495c-a93c-f9c70955a7ae req-6a89eb9f-e860-4829-9a56-6e17c61ac7f5 service neutron] 10.222.0.43 "GET /v2.0/networks?id=4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 200 len: 919 time: 0.1110806 Aug 24 03:02:30.748959 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d947cb9-dc45-495c-a93c-f9c70955a7ae req-d4fd908b-71f9-4fb9-acb2-2fabb39ec712 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=706be5c2-c6fb-496a-ac91-104e4cc11ae7 HTTP/1.1" status: 200 len: 217 time: 0.0367477 Aug 24 03:02:30.800955 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d947cb9-dc45-495c-a93c-f9c70955a7ae req-c05fb92d-fc27-4db3-89ff-2b76e9a78105 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:30.802450 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d947cb9-dc45-495c-a93c-f9c70955a7ae req-c05fb92d-fc27-4db3-89ff-2b76e9a78105 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4f536c4e-b790-4630-bdc6-867501285c32 HTTP/1.1" status: 200 len: 858 time: 0.0427189 Aug 24 03:02:30.836673 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d947cb9-dc45-495c-a93c-f9c70955a7ae req-4d64ccca-18b6-4de8-b81e-95ed70ada303 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=4091852f-86f8-4dac-87af-44624502a74d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0245214 Aug 24 03:02:30.931013 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d947cb9-dc45-495c-a93c-f9c70955a7ae req-c0b3153a-6b9c-4ff7-a430-65e22776ce6d service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863559 Aug 24 03:02:31.028794 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1d947cb9-dc45-495c-a93c-f9c70955a7ae req-09839f30-6482-43a1-95da-738f89fe0bed service neutron] 10.222.0.43 "GET /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842605 Aug 24 03:02:31.650344 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9941f16d-cdd9-4815-bd1f-5bbdbcf4cd2b req-05e25aed-19c6-4c25-9be2-98bba8fcc2e0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:31.651826 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9941f16d-cdd9-4815-bd1f-5bbdbcf4cd2b req-05e25aed-19c6-4c25-9be2-98bba8fcc2e0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0504282 Aug 24 03:02:31.691077 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9941f16d-cdd9-4815-bd1f-5bbdbcf4cd2b req-b26082dc-8c44-4489-a877-5d0aa9f6c3a4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322778 Aug 24 03:02:31.801324 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32e61261-64e4-439f-87d8-3badf7e442c5 req-58e7deae-09ed-4c00-ad40-109db055f7cf tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:31.802778 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-32e61261-64e4-439f-87d8-3badf7e442c5 req-58e7deae-09ed-4c00-ad40-109db055f7cf tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0478909 Aug 24 03:02:31.840917 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-32e61261-64e4-439f-87d8-3badf7e442c5 req-245453a5-f082-41c3-b635-fe4cce362b5d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0322793 Aug 24 03:02:32.803619 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bef46ea-c7a2-4b2c-83d5-4284be290ddd req-17da2a14-75f6-41aa-b1fa-b925d690963d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:32.805075 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9bef46ea-c7a2-4b2c-83d5-4284be290ddd req-17da2a14-75f6-41aa-b1fa-b925d690963d tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0476315 Aug 24 03:02:32.844107 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9bef46ea-c7a2-4b2c-83d5-4284be290ddd req-e6400a3c-bcbc-431b-834b-2408e876b73f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329666 Aug 24 03:02:32.961749 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b26ea2f2-5f10-4880-8052-d3b7ad59265a req-64292f0f-3ebf-4d92-aa97-cc8b0e230577 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:32.963348 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b26ea2f2-5f10-4880-8052-d3b7ad59265a req-64292f0f-3ebf-4d92-aa97-cc8b0e230577 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0518537 Aug 24 03:02:33.000341 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b26ea2f2-5f10-4880-8052-d3b7ad59265a req-cb8b811e-8736-481d-9252-86048f3c614b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0309479 Aug 24 03:02:33.959855 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eee3c51e-5738-4f51-ab52-848080de639d req-2be194b1-1c2c-4d29-abe6-4dec537b8959 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:33.961303 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-eee3c51e-5738-4f51-ab52-848080de639d req-2be194b1-1c2c-4d29-abe6-4dec537b8959 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0487893 Aug 24 03:02:33.997694 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-eee3c51e-5738-4f51-ab52-848080de639d req-b93b5dbd-d97f-43e8-bee0-f85dd4468bb4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0303812 Aug 24 03:02:34.128837 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60a9eba7-4f1e-47c6-9545-2968398405ba req-782bc040-969e-47a9-a1bc-8919ae116fb4 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:34.130545 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-60a9eba7-4f1e-47c6-9545-2968398405ba req-782bc040-969e-47a9-a1bc-8919ae116fb4 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0495439 Aug 24 03:02:34.173274 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-60a9eba7-4f1e-47c6-9545-2968398405ba req-8177c26b-9e79-49d3-a529-f268b8a07ad0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0366070 Aug 24 03:02:35.302242 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503d45f5-dcc6-4b41-8968-b41e0fd5e4fc req-a7cd7eca-6ea3-4c17-aefb-b84af9a2f8ce tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:35.303854 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-503d45f5-dcc6-4b41-8968-b41e0fd5e4fc req-a7cd7eca-6ea3-4c17-aefb-b84af9a2f8ce tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0546367 Aug 24 03:02:35.340443 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-503d45f5-dcc6-4b41-8968-b41e0fd5e4fc req-78c41490-6557-4a5a-babf-6cbe463d8ead tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0306041 Aug 24 03:02:35.913760 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-99508885-925a-4c0a-9eeb-c5e0a754990c req-de0e073c-b404-4809-b4de-4d6a709a71e9 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0381429 Aug 24 03:02:35.986458 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99508885-925a-4c0a-9eeb-c5e0a754990c req-8b38ed08-1818-47a8-932f-349bcf80aaf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:35.987934 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-99508885-925a-4c0a-9eeb-c5e0a754990c req-8b38ed08-1818-47a8-932f-349bcf80aaf5 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 1099 time: 0.0463412 Aug 24 03:02:36.100172 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99508885-925a-4c0a-9eeb-c5e0a754990c req-c9e6480e-a6d5-4c3b-a996-5848953291b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:36.101686 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-99508885-925a-4c0a-9eeb-c5e0a754990c req-c9e6480e-a6d5-4c3b-a996-5848953291b4 service neutron] 10.222.0.43 "GET /v2.0/networks?id=f35e751d-f371-4788-abda-6a58b8a779df HTTP/1.1" status: 200 len: 911 time: 0.0832477 Aug 24 03:02:36.172363 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-99508885-925a-4c0a-9eeb-c5e0a754990c req-abe9b6b8-394b-4f71-9e11-ae02f48e7b6a service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd HTTP/1.1" status: 200 len: 1002 time: 0.0622339 Aug 24 03:02:36.225121 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99508885-925a-4c0a-9eeb-c5e0a754990c req-1fc6417f-d3bf-40ac-bbd6-72d11857c6f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:36.226628 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-99508885-925a-4c0a-9eeb-c5e0a754990c req-1fc6417f-d3bf-40ac-bbd6-72d11857c6f6 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=14102a94-a55b-43e1-a7a9-4210a4c2e2fb HTTP/1.1" status: 200 len: 849 time: 0.0442584 Aug 24 03:02:36.278487 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99508885-925a-4c0a-9eeb-c5e0a754990c req-b21e1351-6425-4348-940a-5541968453db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:36.279993 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-99508885-925a-4c0a-9eeb-c5e0a754990c req-b21e1351-6425-4348-940a-5541968453db service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=f35e751d-f371-4788-abda-6a58b8a779df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0428727 Aug 24 03:02:36.390979 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-99508885-925a-4c0a-9eeb-c5e0a754990c req-e4b41d30-a6cc-4ab4-953d-75059eb41927 service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880363 Aug 24 03:02:36.461763 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bdcf030-7b17-480d-94c2-a721c77d67aa req-5ee8e9e8-e9ca-4609-99cc-b74bcefbfe58 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:36.465908 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8bdcf030-7b17-480d-94c2-a721c77d67aa req-5ee8e9e8-e9ca-4609-99cc-b74bcefbfe58 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0506842 Aug 24 03:02:36.488239 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-99508885-925a-4c0a-9eeb-c5e0a754990c req-a3c8a188-8542-42be-b515-597cbdbed254 service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871913 Aug 24 03:02:36.504080 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8bdcf030-7b17-480d-94c2-a721c77d67aa req-4566b725-9953-44a0-a60f-4cac4dc913bf tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0341768 Aug 24 03:02:37.621338 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f75be4ba-1ddc-4f41-be8f-81072befe998 req-a14489f0-7c0e-4cf8-9b1f-5b0bb8af9dcc tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:37.622816 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f75be4ba-1ddc-4f41-be8f-81072befe998 req-a14489f0-7c0e-4cf8-9b1f-5b0bb8af9dcc tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0480731 Aug 24 03:02:37.659474 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f75be4ba-1ddc-4f41-be8f-81072befe998 req-0024af3e-79cd-4d0b-8681-adf43827ad78 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0308652 Aug 24 03:02:38.570219 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:38.776597 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcffddd7-547d-495a-87c2-d41e1a27c1e5 req-b1f84926-0685-4900-be8e-0987bb7fe07c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:38.778183 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fcffddd7-547d-495a-87c2-d41e1a27c1e5 req-b1f84926-0685-4900-be8e-0987bb7fe07c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0479448 Aug 24 03:02:38.815715 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fcffddd7-547d-495a-87c2-d41e1a27c1e5 req-9b27da85-09d6-4293-849e-3f094dd59dd9 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0318518 Aug 24 03:02:39.331121 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 881a8667-42c4-4263-84c5-a172725c834f details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:02:39.422317 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=881a8667-42c4-4263-84c5-a172725c834f,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:39.433137 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '881a8667-42c4-4263-84c5-a172725c834f', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'port_id': '881a8667-42c4-4263-84c5-a172725c834f', 'mac_address': 'fa:16:3e:85:26:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:02:39.472378 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:39.484382 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 881a8667-42c4-4263-84c5-a172725c834f {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:02:39.503182 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=881a8667-42c4-4263-84c5-a172725c834f,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:39.591488 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:39.637569 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=881a8667-42c4-4263-84c5-a172725c834f,revision_number=6']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:39.937189 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753144df-cd2f-4c80-85f0-3ff8d603cdbd req-f73fd92f-2c6a-48b5-b717-f31e17a287ca tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:39.938650 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-753144df-cd2f-4c80-85f0-3ff8d603cdbd req-f73fd92f-2c6a-48b5-b717-f31e17a287ca tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 945 time: 0.0514154 Aug 24 03:02:39.975211 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-753144df-cd2f-4c80-85f0-3ff8d603cdbd req-b0d912a0-9449-43c0-a285-24504d83260d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0306187 Aug 24 03:02:40.453928 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['881a8667-42c4-4263-84c5-a172725c834f'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:02:41.102380 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5f09c70-49dc-4d3e-a837-e54469dbe8cf req-850b6a6e-c92a-47c6-a15b-ddd8691ceccd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:41.103834 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b5f09c70-49dc-4d3e-a837-e54469dbe8cf req-850b6a6e-c92a-47c6-a15b-ddd8691ceccd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 945 time: 0.0553780 Aug 24 03:02:41.142243 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b5f09c70-49dc-4d3e-a837-e54469dbe8cf req-151558b0-28c2-49e0-b84a-16cc394e678e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0321226 Aug 24 03:02:42.264346 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2267dfca-fec5-4a60-8907-033f748e2c76 req-2d232bfd-6b4a-4388-9633-0c1087196eab tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:42.265815 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2267dfca-fec5-4a60-8907-033f748e2c76 req-2d232bfd-6b4a-4388-9633-0c1087196eab tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 945 time: 0.0476525 Aug 24 03:02:42.303073 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2267dfca-fec5-4a60-8907-033f748e2c76 req-12877eb1-eec1-4dce-bd9b-261a80d7c10b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0310259 Aug 24 03:02:42.967949 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6966ee-93c9-48c3-85c2-92112a50ac07 req-9cffb67b-150a-4829-90ec-654418e872a7 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:42.969419 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2a6966ee-93c9-48c3-85c2-92112a50ac07 req-9cffb67b-150a-4829-90ec-654418e872a7 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0471096 Aug 24 03:02:43.007857 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2a6966ee-93c9-48c3-85c2-92112a50ac07 req-392bca40-14a9-4cc4-a726-799bec2746ff tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318556 Aug 24 03:02:43.421923 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd14caee-8f50-4ddb-95bc-4ab53ef35e2d req-1d9e9417-a3c3-49e9-a74f-fdc21e0e0ad3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:43.423382 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fd14caee-8f50-4ddb-95bc-4ab53ef35e2d req-1d9e9417-a3c3-49e9-a74f-fdc21e0e0ad3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 945 time: 0.0472643 Aug 24 03:02:43.461541 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fd14caee-8f50-4ddb-95bc-4ab53ef35e2d req-092691a0-166b-4d11-90e8-078b7d4982f1 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0317442 Aug 24 03:02:43.538602 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 881a8667-42c4-4263-84c5-a172725c834f up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:02:43.585379 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 881a8667-42c4-4263-84c5-a172725c834f triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:43.585787 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:43.659063 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:43.683161 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '881a8667-42c4-4263-84c5-a172725c834f'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:02:43.685359 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f7cdf826-d0cb-4a9a-8a50-d25d5b3c5263" -d '{"events": [{"server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "name": "network-vif-plugged", "status": "completed", "tag": "881a8667-42c4-4263-84c5-a172725c834f"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:02:43.698590 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=881a8667-42c4-4263-84c5-a172725c834f,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:43.722005 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:02:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-28150664-1ed8-4b1f-b3f6-00605c31dd75 x-openstack-request-id: req-28150664-1ed8-4b1f-b3f6-00605c31dd75 {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:02:43.722291 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "name": "network-vif-plugged", "status": "completed", "tag": "881a8667-42c4-4263-84c5-a172725c834f", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:02:43.722537 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-28150664-1ed8-4b1f-b3f6-00605c31dd75 {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:02:43.722933 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '881a8667-42c4-4263-84c5-a172725c834f', 'code': 200} Aug 24 03:02:43.793304 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:43.840524 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=881a8667-42c4-4263-84c5-a172725c834f,revision_number=7']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:44.122038 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b615f1-8eb7-4c47-8a63-d8a83a6715cf req-5fef19bf-f5d0-44ba-9357-fb6f0a647a77 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:44.123505 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f1b615f1-8eb7-4c47-8a63-d8a83a6715cf req-5fef19bf-f5d0-44ba-9357-fb6f0a647a77 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0477946 Aug 24 03:02:44.159898 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f1b615f1-8eb7-4c47-8a63-d8a83a6715cf req-9e64b027-b324-4861-a632-7c58f4a1d811 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302114 Aug 24 03:02:44.582323 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0777fa71-99b7-4a25-b70c-298baef0654f req-c99664ef-1d81-4ecf-ab0d-92f52c483dc7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:44.584622 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0777fa71-99b7-4a25-b70c-298baef0654f req-c99664ef-1d81-4ecf-ab0d-92f52c483dc7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0521231 Aug 24 03:02:44.621856 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0777fa71-99b7-4a25-b70c-298baef0654f req-ff0d0341-056a-4a59-a1e9-ca73028da3d5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0311260 Aug 24 03:02:45.278114 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb0ced7-ad5b-48bc-8cc9-7d76bc86075d req-cf56dcd5-982f-4b02-9609-67eda70dc91f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:45.279560 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fdb0ced7-ad5b-48bc-8cc9-7d76bc86075d req-cf56dcd5-982f-4b02-9609-67eda70dc91f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0511556 Aug 24 03:02:45.316712 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fdb0ced7-ad5b-48bc-8cc9-7d76bc86075d req-0a3664f3-544c-429b-bd89-d35f717145ef tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312293 Aug 24 03:02:45.742734 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e343169e-d162-4d47-bab9-03246ed7bff9 req-1fe12208-2236-46a7-a3e4-51983a68413d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:45.744166 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e343169e-d162-4d47-bab9-03246ed7bff9 req-1fe12208-2236-46a7-a3e4-51983a68413d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0512872 Aug 24 03:02:45.780397 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e343169e-d162-4d47-bab9-03246ed7bff9 req-a86f1644-fde8-4947-8329-54da1994fa43 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0304294 Aug 24 03:02:46.435479 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee290373-2fc2-4c92-ad0c-e0f1f37687b1 req-6a6ac084-8f94-4cff-8355-4bb75b6e2b08 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:46.437210 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ee290373-2fc2-4c92-ad0c-e0f1f37687b1 req-6a6ac084-8f94-4cff-8355-4bb75b6e2b08 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0491364 Aug 24 03:02:46.476089 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ee290373-2fc2-4c92-ad0c-e0f1f37687b1 req-9a167190-137c-4597-a5fc-53ae5bf2e93c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319486 Aug 24 03:02:46.901175 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fa23ab7-988d-4bac-982a-395e238ca760 req-3d15550c-965d-4f02-a4e2-58d962fb62bd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:46.902653 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1fa23ab7-988d-4bac-982a-395e238ca760 req-3d15550c-965d-4f02-a4e2-58d962fb62bd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0504873 Aug 24 03:02:46.942211 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1fa23ab7-988d-4bac-982a-395e238ca760 req-8e8b193b-48c3-464b-88ba-ed4e31d6ff4c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0328615 Aug 24 03:02:47.572865 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:02:47.592265 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11be666b-e31b-4d0d-9da0-cf9a760595b3 req-baba91d5-1294-4ef3-b1f8-91bc8169fbd9 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:47.600153 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11be666b-e31b-4d0d-9da0-cf9a760595b3 req-baba91d5-1294-4ef3-b1f8-91bc8169fbd9 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0559447 Aug 24 03:02:47.648188 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11be666b-e31b-4d0d-9da0-cf9a760595b3 req-b767261e-7ff1-4a5c-b19b-c082994edf17 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416846 Aug 24 03:02:48.080710 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a0a1c5-012f-4fe6-a0fc-dbd29f5d4e45 req-dcee4b1e-db62-45ff-8043-0f34866184e4 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:48.082925 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-71a0a1c5-012f-4fe6-a0fc-dbd29f5d4e45 req-dcee4b1e-db62-45ff-8043-0f34866184e4 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0537817 Aug 24 03:02:48.122783 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-71a0a1c5-012f-4fe6-a0fc-dbd29f5d4e45 req-69939530-1464-4849-b388-c5d6500b650f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0329983 Aug 24 03:02:48.764001 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbbd1228-fef1-4e4a-8d58-3d3e9beed348 req-4f0a4016-54bc-46f5-afd8-d061696eb2c0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:48.766376 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bbbd1228-fef1-4e4a-8d58-3d3e9beed348 req-4f0a4016-54bc-46f5-afd8-d061696eb2c0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0544720 Aug 24 03:02:48.837812 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184a70d8-fd97-4ccb-9a53-77e716c8352f req-c8203bdb-c19f-401e-9308-2e4b50d2bc82 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:48.839316 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-184a70d8-fd97-4ccb-9a53-77e716c8352f req-c8203bdb-c19f-401e-9308-2e4b50d2bc82 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.43 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 945 time: 0.0603526 Aug 24 03:02:48.863930 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bbbd1228-fef1-4e4a-8d58-3d3e9beed348 req-aabd495c-6357-4c6d-856d-d079347656ea tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0907764 Aug 24 03:02:48.963866 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-184a70d8-fd97-4ccb-9a53-77e716c8352f req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Deleting port 659513ab-6408-4e0e-b7d4-dea0216a385c {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:02:48.963866 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-184a70d8-fd97-4ccb-9a53-77e716c8352f req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:49.055849 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-184a70d8-fd97-4ccb-9a53-77e716c8352f req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] For port 659513ab-6408-4e0e-b7d4-dea0216a385c, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=659513ab-6408-4e0e-b7d4-dea0216a385c,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:49.056216 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-184a70d8-fd97-4ccb-9a53-77e716c8352f req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:49.070305 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-184a70d8-fd97-4ccb-9a53-77e716c8352f req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Calling delete_port for 659513ab-6408-4e0e-b7d4-dea0216a385c owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:02:49.268765 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe38fc07-544b-49cd-9f88-647f40a09ac2 req-fed1fbc1-ad63-4e31-927f-303e20895827 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:49.270440 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fe38fc07-544b-49cd-9f88-647f40a09ac2 req-fed1fbc1-ad63-4e31-927f-303e20895827 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0563288 Aug 24 03:02:49.320651 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-184a70d8-fd97-4ccb-9a53-77e716c8352f req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:49.329897 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fe38fc07-544b-49cd-9f88-647f40a09ac2 req-27c0a596-293d-40d9-8590-b3650856bd9f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0478935 Aug 24 03:02:49.333508 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['706be5c2-c6fb-496a-ac91-104e4cc11ae7', '659513ab-6408-4e0e-b7d4-dea0216a385c'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:02:49.379398 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Pushing event deleted for resources: {'Port': ['ID=659513ab-6408-4e0e-b7d4-dea0216a385c,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:49.396925 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:49.397248 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:49.397753 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:49.398093 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:49.398427 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:49.398874 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:49.399209 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:49.399683 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:49.399886 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:49.400172 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:49.400484 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:49.400824 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:02:49.478682 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-184a70d8-fd97-4ccb-9a53-77e716c8352f req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] No DVR routers for this DVR port 659513ab-6408-4e0e-b7d4-dea0216a385c on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:02:49.481447 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-184a70d8-fd97-4ccb-9a53-77e716c8352f req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:49.483791 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-184a70d8-fd97-4ccb-9a53-77e716c8352f req-6a7eefd2-a21e-4edd-b660-4fdebbb3f7f2 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.43 "DELETE /v2.0/ports/659513ab-6408-4e0e-b7d4-dea0216a385c HTTP/1.1" status: 204 len: 173 time: 0.6321888 Aug 24 03:02:49.484249 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cd5b8f9e-cb7a-4828-b977-8189ee4a6aef', 'name': 'network-vif-deleted', 'tag': '659513ab-6408-4e0e-b7d4-dea0216a385c'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:02:49.486532 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9cc4c1e1-02ba-402d-897b-86ee767a5071" -d '{"events": [{"server_uuid": "cd5b8f9e-cb7a-4828-b977-8189ee4a6aef", "name": "network-vif-deleted", "tag": "659513ab-6408-4e0e-b7d4-dea0216a385c"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:02:49.629941 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:02:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31962e66-67f8-419e-ae77-d907a5c211d3 x-openstack-request-id: req-31962e66-67f8-419e-ae77-d907a5c211d3 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:02:49.633226 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cd5b8f9e-cb7a-4828-b977-8189ee4a6aef", "name": "network-vif-deleted", "tag": "659513ab-6408-4e0e-b7d4-dea0216a385c", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:02:49.633226 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-31962e66-67f8-419e-ae77-d907a5c211d3 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:02:49.633226 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cd5b8f9e-cb7a-4828-b977-8189ee4a6aef', 'name': 'network-vif-deleted', 'tag': '659513ab-6408-4e0e-b7d4-dea0216a385c', 'status': 'completed', 'code': 200} Aug 24 03:02:49.742896 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-25fe49b4-12ff-48d5-a6ab-9d1fae8a0188 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1453650260&fields=id&tenant_id=03198f839b864099b1c011c0fc54c7dd HTTP/1.1" status: 200 len: 267 time: 0.0522346 Aug 24 03:02:49.868640 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-5467351e-23b0-4b44-aeac-6665ed4e1d0f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:49.870181 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-5467351e-23b0-4b44-aeac-6665ed4e1d0f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 812 time: 0.1209688 Aug 24 03:02:49.892516 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-30ff2417-529f-41d7-a69e-09d66b77df83 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/quotas/03198f839b864099b1c011c0fc54c7dd HTTP/1.1" status: 200 len: 375 time: 0.0153477 Aug 24 03:02:49.978071 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-4d797118-b77b-4e65-a39d-839a2af44db5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0845337 Aug 24 03:02:50.038929 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-284c850d-5708-430b-971a-157ff1c0f4a1 req-4f611dcf-19dc-47bc-9cc4-705b59fddfbf tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 210 time: 0.0272186 Aug 24 03:02:50.114354 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-30cf9f32-5219-4121-80af-e782910bef49 service neutron] 10.222.0.30 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1218996 Aug 24 03:02:50.255853 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-7483e62e-6105-4097-b815-545d05b178df service neutron] 10.222.0.30 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1341145 Aug 24 03:02:50.502789 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c61b61-94b2-44b6-8aba-32a1a4c711a8 req-ae32141f-2e3d-4d09-8b26-bcdfa1c7b397 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:50.503705 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-37c61b61-94b2-44b6-8aba-32a1a4c711a8 req-ae32141f-2e3d-4d09-8b26-bcdfa1c7b397 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0773208 Aug 24 03:02:50.554185 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-37c61b61-94b2-44b6-8aba-32a1a4c711a8 req-15a1d483-51cc-41c1-b08e-5e6b6c149de4 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0437224 Aug 24 03:02:51.148350 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4e96ed45-6569-4932-8210-1c91f02e3b77 req-338f0a41-0929-45b2-b977-c7e118d48a6f tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=cd5b8f9e-cb7a-4828-b977-8189ee4a6aef HTTP/1.1" status: 200 len: 210 time: 0.0265591 Aug 24 03:02:51.622526 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c294c26b-33f3-430f-8d55-90599db58418 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:51.642890 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9e731a9a-7169-4ca7-bdf3-b1ca113e489d req-1944b7aa-a9af-4342-a1f0-18682a701d08 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 210 time: 0.0533154 Aug 24 03:02:51.807992 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-634e6601-2187-4ba4-ac96-7a422562233f req-79a5657d-5204-4138-aaf6-dd04dea7e615 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:51.812284 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-634e6601-2187-4ba4-ac96-7a422562233f req-79a5657d-5204-4138-aaf6-dd04dea7e615 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0859215 Aug 24 03:02:51.862136 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-634e6601-2187-4ba4-ac96-7a422562233f req-09be7390-8cd4-4693-b0ab-6448d5cb3e5a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0448327 Aug 24 03:02:52.759686 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a4f38947-bbb8-4566-8f77-dfcd21df13f4 req-8e1d7fdd-ea05-4857-a35f-1254cf2c6e60 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 210 time: 0.0359302 Aug 24 03:02:52.955716 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 659513ab-6408-4e0e-b7d4-dea0216a385c no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:02:52.989761 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 659513ab-6408-4e0e-b7d4-dea0216a385c {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:02:52.990178 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 659513ab-6408-4e0e-b7d4-dea0216a385c not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:02:53.080591 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c754a225-4a40-4d94-9781-469810876a8a req-cba93e6f-ee8b-47c1-8a79-a9494d2e6cc6 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:53.082684 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c754a225-4a40-4d94-9781-469810876a8a req-cba93e6f-ee8b-47c1-8a79-a9494d2e6cc6 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0685582 Aug 24 03:02:53.111445 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d501c07-d288-4276-a60d-51be28a42002 req-500097fb-b526-4053-a08d-d78d8eb08fa4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:53.120668 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9d501c07-d288-4276-a60d-51be28a42002 req-500097fb-b526-4053-a08d-d78d8eb08fa4 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0738497 Aug 24 03:02:53.139646 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c754a225-4a40-4d94-9781-469810876a8a req-1565b40a-e101-4663-a05d-8f479480c85f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0491083 Aug 24 03:02:53.163531 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9d501c07-d288-4276-a60d-51be28a42002 req-b35dfd47-5a3a-4856-b746-86b705b9a19c tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416391 Aug 24 03:02:53.998583 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-090724d9-1993-41b6-aee4-5bf9c755ed51 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:54.110013 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-167ab36c-e772-4d36-94d0-fa9bcd373314 req-e8ba354c-e6df-418b-b594-a55fe70c4404 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 210 time: 0.2845399 Aug 24 03:02:54.284231 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dfa4423-6419-44a9-bd11-15561434bd09 req-32c6e922-1e60-4927-8032-b25d65bfdb29 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:54.287852 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8dfa4423-6419-44a9-bd11-15561434bd09 req-32c6e922-1e60-4927-8032-b25d65bfdb29 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0648456 Aug 24 03:02:54.334740 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8dfa4423-6419-44a9-bd11-15561434bd09 req-d36f1dcf-1a0f-42d5-a409-a66d2a1e94aa tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0403805 Aug 24 03:02:54.344944 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:54.463444 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a130ff72-662e-40ff-b6bd-ecaa2b781d9d req-1bd39ffe-7ffd-4af9-b185-df55cf2e583b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:54.465466 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a130ff72-662e-40ff-b6bd-ecaa2b781d9d req-1bd39ffe-7ffd-4af9-b185-df55cf2e583b tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0595658 Aug 24 03:02:54.524687 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a130ff72-662e-40ff-b6bd-ecaa2b781d9d req-3fcd77fc-3e74-4d53-93fe-6f171a6b8467 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516584 Aug 24 03:02:55.220933 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e934310a-07ce-41c9-9873-a729b4dbf7e6 req-22136eff-d630-44a9-98e3-a8243e517cc8 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:55.221899 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e934310a-07ce-41c9-9873-a729b4dbf7e6 req-22136eff-d630-44a9-98e3-a8243e517cc8 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 945 time: 0.0529191 Aug 24 03:02:55.240341 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-135804a4-b0a8-4651-aa39-a596f99bef97 req-54ccd938-c734-44d3-b13f-c035ed4215c1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 210 time: 0.0465751 Aug 24 03:02:55.261891 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e934310a-07ce-41c9-9873-a729b4dbf7e6 req-a09715d2-7925-416d-9276-0aa094aabcf7 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338919 Aug 24 03:02:55.475745 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-25ed04b8-f646-45cb-ab37-bab520d72bbb tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:55.477757 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-25ed04b8-f646-45cb-ab37-bab520d72bbb tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 812 time: 0.1676233 Aug 24 03:02:55.479336 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e65d757-46fe-41eb-bbff-bfb5f36f744a req-0ee49387-6f21-4bf7-9cfd-9f6ac6245df6 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:55.486584 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8e65d757-46fe-41eb-bbff-bfb5f36f744a req-0ee49387-6f21-4bf7-9cfd-9f6ac6245df6 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0653474 Aug 24 03:02:55.534417 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-79d5dc13-fb41-40a1-9e04-9874d5241a5f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=03198f839b864099b1c011c0fc54c7dd HTTP/1.1" status: 200 len: 380 time: 0.0421042 Aug 24 03:02:55.539262 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8e65d757-46fe-41eb-bbff-bfb5f36f744a req-f36d341f-5567-4d16-87ef-04b20428a964 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0419400 Aug 24 03:02:55.547236 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'port': {'device_id': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'admin_state_up': True, 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'security_groups': ['b69cad14-2388-40cc-8cc6-0b7d617b183d']}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:55.592066 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:55.758147 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8095296-6170-4f6a-9150-79b06fc5f233 req-e2e1e0f9-e20a-4e71-8aa8-cc655c99b54e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:55.760043 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c8095296-6170-4f6a-9150-79b06fc5f233 req-e2e1e0f9-e20a-4e71-8aa8-cc655c99b54e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.1055872 Aug 24 03:02:55.810788 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c8095296-6170-4f6a-9150-79b06fc5f233 req-5c82f7b2-00c8-4945-b515-0536dd011205 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425599 Aug 24 03:02:55.815911 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Made reservation on behalf of 03198f839b864099b1c011c0fc54c7dd for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:02:55.825732 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:55.966376 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Allocated IP 172.20.0.4 (3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6/9d24a59e-1441-41fd-b523-3368836ed9c4/894657b8-22e4-4340-af94-46bb6d84e3d7) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:02:56.136396 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:56.152052 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Transition to ACTIVE for port object 894657b8-22e4-4340-af94-46bb6d84e3d7 will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:56.278340 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:56.328230 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:02:56.332705 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:02:56.337611 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:02:56.377313 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'Port': ['ID=894657b8-22e4-4340-af94-46bb6d84e3d7,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:56.418143 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:56.419193 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:56.516843 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d36a53-2626-419b-9821-25a018206ba2 req-d8c8b9a2-8f54-4da2-ba1c-b945b0e0241a tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:56.518435 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a1d36a53-2626-419b-9821-25a018206ba2 req-d8c8b9a2-8f54-4da2-ba1c-b945b0e0241a tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 945 time: 0.0667963 Aug 24 03:02:56.523689 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1faaefa-d11a-4366-94b2-c54307039e28 req-ed17d8b1-8a42-43f3-973e-116600122cbf tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:56.526631 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e1faaefa-d11a-4366-94b2-c54307039e28 req-ed17d8b1-8a42-43f3-973e-116600122cbf tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 931 time: 0.0739737 Aug 24 03:02:56.594010 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e1faaefa-d11a-4366-94b2-c54307039e28 req-eefff221-5ca2-4616-af55-ff9539716a0d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0527868 Aug 24 03:02:56.606715 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e0161e00-d4e0-4b47-9efa-e99e0a7b54de tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0637975 Aug 24 03:02:56.618394 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a1d36a53-2626-419b-9821-25a018206ba2 req-1803e602-0f19-44a1-b007-aec160b1a772 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0886252 Aug 24 03:02:56.629481 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Request body: {'port': {'device_id': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:02:56.713714 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:56.760724 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4fbeb73-388d-450a-baee-ae40c2f5210a req-fba1f60d-a055-4fd0-b4fa-b958e7f05755 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:56.762321 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c4fbeb73-388d-450a-baee-ae40c2f5210a req-fba1f60d-a055-4fd0-b4fa-b958e7f05755 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0593562 Aug 24 03:02:56.764447 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-43a53a5c-f85f-40cc-a7ec-84b079779b06 None None] Provisioning for port 894657b8-22e4-4340-af94-46bb6d84e3d7 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:02:56.768711 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-43a53a5c-f85f-40cc-a7ec-84b079779b06 None None] Provisioning complete for port 894657b8-22e4-4340-af94-46bb6d84e3d7 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:02:56.769266 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-43a53a5c-f85f-40cc-a7ec-84b079779b06 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:56.821046 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-43a53a5c-f85f-40cc-a7ec-84b079779b06 None None] Port 894657b8-22e4-4340-af94-46bb6d84e3d7 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:02:56.858990 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c4fbeb73-388d-450a-baee-ae40c2f5210a req-8fe157af-d2de-481c-8abd-87670a1bc271 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0832698 Aug 24 03:02:56.943437 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:57.014858 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f2e4477-e67a-40e9-9c19-bd526a9b4a13 req-5cb80717-643c-4fb5-91b5-870c590da82e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:57.016337 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6f2e4477-e67a-40e9-9c19-bd526a9b4a13 req-5cb80717-643c-4fb5-91b5-870c590da82e tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.0964158 Aug 24 03:02:57.093571 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6f2e4477-e67a-40e9-9c19-bd526a9b4a13 req-3bbab685-2fdb-441d-b166-63e80e2fa9bd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690641 Aug 24 03:02:57.141355 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 894657b8-22e4-4340-af94-46bb6d84e3d7 {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:02:57.153608 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:57.167434 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Transition to ACTIVE for port object 894657b8-22e4-4340-af94-46bb6d84e3d7 will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:02:57.237707 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:57.289013 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Pushing event updated for resources: {'Port': ['ID=894657b8-22e4-4340-af94-46bb6d84e3d7,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:57.403187 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Attempting to bind port 894657b8-22e4-4340-af94-46bb6d84e3d7 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:02:57.403526 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Attempting to bind port 894657b8-22e4-4340-af94-46bb6d84e3d7 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:02:57.403860 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Attempting to bind port 894657b8-22e4-4340-af94-46bb6d84e3d7 on network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:02:57.412402 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Port 894657b8-22e4-4340-af94-46bb6d84e3d7 on network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:02:57.412660 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Attempting to bind port 894657b8-22e4-4340-af94-46bb6d84e3d7 on network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:02:57.423652 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 2, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:02:57.424078 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Checking segment: {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:02:57.424591 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Bound using segment: {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:02:57.425127 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Bound port: 894657b8-22e4-4340-af94-46bb6d84e3d7, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:02:57.425751 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:57.458998 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08372a51-81e3-434b-b57f-d7b2113de54f req-4851349a-5d89-49d6-8b45-41b3270bc230 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:57.460845 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-08372a51-81e3-434b-b57f-d7b2113de54f req-4851349a-5d89-49d6-8b45-41b3270bc230 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 945 time: 0.1220942 Aug 24 03:02:57.602545 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] For port 894657b8-22e4-4340-af94-46bb6d84e3d7, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:02:57.608208 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] For port 894657b8-22e4-4340-af94-46bb6d84e3d7, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=894657b8-22e4-4340-af94-46bb6d84e3d7,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:02:57.638319 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-08372a51-81e3-434b-b57f-d7b2113de54f req-47946387-90b7-466d-aad8-165b93fde29f tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Deleting port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:02:57.638777 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-08372a51-81e3-434b-b57f-d7b2113de54f req-47946387-90b7-466d-aad8-165b93fde29f tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:57.737264 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:57.751751 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a166e761-ffe0-4b34-b138-e21f8fc698f9 req-ddcb2afa-f271-4a02-a43b-e4f5cc377682 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:57.759855 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a166e761-ffe0-4b34-b138-e21f8fc698f9 req-ddcb2afa-f271-4a02-a43b-e4f5cc377682 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 943 time: 0.0837567 Aug 24 03:02:57.807220 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a166e761-ffe0-4b34-b138-e21f8fc698f9 req-90fdd986-1821-4afb-99f8-bed8ada791a7 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461533 Aug 24 03:02:57.817866 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:57.818495 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:57.820026 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] 10.222.0.43 "PUT /v2.0/ports/894657b8-22e4-4340-af94-46bb6d84e3d7 HTTP/1.1" status: 200 len: 1093 time: 1.1965423 Aug 24 03:02:57.827329 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'tag': '894657b8-22e4-4340-af94-46bb6d84e3d7'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:02:57.834513 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4d157b1d-ad0d-4ab4-b029-5653dfbc957e" -d '{"events": [{"name": "network-changed", "server_uuid": "07edef45-7d42-46a0-89b8-2a6e24a64a16", "tag": "894657b8-22e4-4340-af94-46bb6d84e3d7"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:02:57.889146 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8eac994-dd46-499c-82b9-2c37b84ca072 service neutron] Pushing event updated for resources: {'Port': ['ID=894657b8-22e4-4340-af94-46bb6d84e3d7,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:57.908901 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:02:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd5f1045-ebc2-456c-87d3-d7abda378fe8 x-openstack-request-id: req-cd5f1045-ebc2-456c-87d3-d7abda378fe8 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:02:57.909796 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "07edef45-7d42-46a0-89b8-2a6e24a64a16", "tag": "894657b8-22e4-4340-af94-46bb6d84e3d7", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:02:57.909796 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cd5f1045-ebc2-456c-87d3-d7abda378fe8 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:02:57.910235 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'tag': '894657b8-22e4-4340-af94-46bb6d84e3d7', 'status': 'completed', 'code': 200} Aug 24 03:02:57.970960 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-613713c9-d857-47aa-8ce9-dd65dd0e70bd req-be3376d9-9833-48c7-af37-ed2550100316 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:57.981004 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-613713c9-d857-47aa-8ce9-dd65dd0e70bd req-be3376d9-9833-48c7-af37-ed2550100316 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 945 time: 0.2584546 Aug 24 03:02:58.030544 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-08372a51-81e3-434b-b57f-d7b2113de54f req-47946387-90b7-466d-aad8-165b93fde29f tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] For port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=a9477ae9-0c3b-41e5-8ae2-b6d764f9b187,segment=NetworkSegment(8153f8c3-eca4-496c-bd4f-59ba0022c639),segment_id=8153f8c3-eca4-496c-bd4f-59ba0022c639)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:58.035410 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e4e6b2-3d99-42b5-bfde-4c5377f543c9 req-f0b16860-fcdb-4d66-ac94-0a76f7d842cf tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:58.037776 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-08372a51-81e3-434b-b57f-d7b2113de54f req-47946387-90b7-466d-aad8-165b93fde29f tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:58.042377 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-68e4e6b2-3d99-42b5-bfde-4c5377f543c9 req-f0b16860-fcdb-4d66-ac94-0a76f7d842cf tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0777435 Aug 24 03:02:58.067377 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d157b1d-ad0d-4ab4-b029-5653dfbc957e req-5f0a5867-0556-4381-b7e3-d77a745c41ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:58.069625 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4d157b1d-ad0d-4ab4-b029-5653dfbc957e req-5f0a5867-0556-4381-b7e3-d77a745c41ad service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 1096 time: 0.1471672 Aug 24 03:02:58.085839 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-613713c9-d857-47aa-8ce9-dd65dd0e70bd req-a0ed4334-7b63-4216-bad8-056e605dadd4 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4b4030d-36ff-4ec4-a865-deeb8b403f2e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0998900 Aug 24 03:02:58.092988 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-08372a51-81e3-434b-b57f-d7b2113de54f req-47946387-90b7-466d-aad8-165b93fde29f tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Calling delete_port for a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:02:58.116380 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-68e4e6b2-3d99-42b5-bfde-4c5377f543c9 req-a286985b-5d94-4271-9e17-b2a6a96df8ee tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0700941 Aug 24 03:02:58.316922 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d157b1d-ad0d-4ab4-b029-5653dfbc957e req-d20094bf-a908-4af0-9bbf-d1b727c19c55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:58.319301 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4d157b1d-ad0d-4ab4-b029-5653dfbc957e req-d20094bf-a908-4af0-9bbf-d1b727c19c55 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=03198f839b864099b1c011c0fc54c7dd&shared=False HTTP/1.1" status: 200 len: 913 time: 0.2319651 Aug 24 03:02:58.327656 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-032094cd-b5bb-4f66-8855-ec66ddb8a27e req-d2f54cf5-21b5-40ff-88e3-a69a583bbc90 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:58.329185 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-032094cd-b5bb-4f66-8855-ec66ddb8a27e req-d2f54cf5-21b5-40ff-88e3-a69a583bbc90 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.1292982 Aug 24 03:02:58.471537 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-032094cd-b5bb-4f66-8855-ec66ddb8a27e req-2e5cd3f4-9d0f-4397-8de2-ab73868c3769 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1300235 Aug 24 03:02:58.497406 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d157b1d-ad0d-4ab4-b029-5653dfbc957e req-9b0d1a55-9fd9-4073-9cda-93bf2fff61aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:58.498989 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4d157b1d-ad0d-4ab4-b029-5653dfbc957e req-9b0d1a55-9fd9-4073-9cda-93bf2fff61aa service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1681905 Aug 24 03:02:58.617621 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-9fff24d2-3905-44e5-b99e-1b8105d2fa4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:58.618048 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-9fff24d2-3905-44e5-b99e-1b8105d2fa4b service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 1096 time: 0.0655346 Aug 24 03:02:58.667050 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-ed87beae-8e47-4f65-a498-229ef33f8719 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=894657b8-22e4-4340-af94-46bb6d84e3d7 HTTP/1.1" status: 200 len: 217 time: 0.0390792 Aug 24 03:02:58.728134 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-f36728c7-3def-4d15-8ba7-b9e3d3b28543 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:58.729606 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-f36728c7-3def-4d15-8ba7-b9e3d3b28543 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 200 len: 851 time: 0.0544324 Aug 24 03:02:58.782345 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-b07dfb78-d871-4256-9e91-6e2d22d6457c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:58.783812 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-b07dfb78-d871-4256-9e91-6e2d22d6457c service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0444326 Aug 24 03:02:58.874175 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-05f26d50-aec5-4c69-8271-c924a514a2dd service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819809 Aug 24 03:02:58.929909 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b6fac85-32e4-4b74-8046-ac721bf8636f req-e6892d28-f39f-4e71-b9ff-e1ed27aa2201 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:58.931400 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5b6fac85-32e4-4b74-8046-ac721bf8636f req-e6892d28-f39f-4e71-b9ff-e1ed27aa2201 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 943 time: 0.0496833 Aug 24 03:02:58.969050 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5b6fac85-32e4-4b74-8046-ac721bf8636f req-1594a771-efdb-48b5-9395-059ee1bd5f14 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311701 Aug 24 03:02:58.969567 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e4fbb3ad-95e8-4e64-8771-ab43ab8be46e req-c9f55afb-164b-4b03-a88e-5115b3608ca9 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875680 Aug 24 03:02:59.172741 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4fe0979f-3404-4fb1-b331-59e07f9a454f req-d1cbdd32-90ca-414f-8819-311de36d533e tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 210 time: 0.0269282 Aug 24 03:02:59.173499 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-08372a51-81e3-434b-b57f-d7b2113de54f req-47946387-90b7-466d-aad8-165b93fde29f tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:59.220948 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47946387-90b7-466d-aad8-165b93fde29f tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Pushing event deleted for resources: {'Port': ['ID=a9477ae9-0c3b-41e5-8ae2-b6d764f9b187,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:59.236888 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e82ede6-5dd8-4c70-b13a-f51ba5b8d2e8 req-45316bb6-5047-43d1-8998-509a4ca606f3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:59.238485 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3e82ede6-5dd8-4c70-b13a-f51ba5b8d2e8 req-45316bb6-5047-43d1-8998-509a4ca606f3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0501845 Aug 24 03:02:59.276533 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-08372a51-81e3-434b-b57f-d7b2113de54f req-47946387-90b7-466d-aad8-165b93fde29f tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] No DVR routers for this DVR port a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:02:59.280702 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-08372a51-81e3-434b-b57f-d7b2113de54f req-47946387-90b7-466d-aad8-165b93fde29f tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:59.283373 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-08372a51-81e3-434b-b57f-d7b2113de54f req-47946387-90b7-466d-aad8-165b93fde29f tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.43 "DELETE /v2.0/ports/a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 HTTP/1.1" status: 204 len: 173 time: 1.7940743 Aug 24 03:02:59.303893 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3e82ede6-5dd8-4c70-b13a-f51ba5b8d2e8 req-1ca015af-c2c1-4514-9764-222c01583e4f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0529330 Aug 24 03:02:59.312339 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a81884ad-a740-436f-8336-c3cc3f204380 req-79d43eef-365c-44c6-8a59-4064fb877eff tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:59.314055 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a81884ad-a740-436f-8336-c3cc3f204380 req-79d43eef-365c-44c6-8a59-4064fb877eff tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.43 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.1299620 Aug 24 03:02:59.423476 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-a81884ad-a740-436f-8336-c3cc3f204380 req-968ebb86-384f-48d6-a9fa-7a2283679d03 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Deleting port 706be5c2-c6fb-496a-ac91-104e4cc11ae7 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:02:59.424168 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-a81884ad-a740-436f-8336-c3cc3f204380 req-968ebb86-384f-48d6-a9fa-7a2283679d03 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:59.530335 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-a81884ad-a740-436f-8336-c3cc3f204380 req-968ebb86-384f-48d6-a9fa-7a2283679d03 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] For port 706be5c2-c6fb-496a-ac91-104e4cc11ae7, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=706be5c2-c6fb-496a-ac91-104e4cc11ae7,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:02:59.530706 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-a81884ad-a740-436f-8336-c3cc3f204380 req-968ebb86-384f-48d6-a9fa-7a2283679d03 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:59.548017 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-a81884ad-a740-436f-8336-c3cc3f204380 req-968ebb86-384f-48d6-a9fa-7a2283679d03 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Calling delete_port for 706be5c2-c6fb-496a-ac91-104e4cc11ae7 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:02:59.660086 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2fd208a-8512-44e0-8daa-c663ff167bae req-41ae6d82-bb78-4ef7-b4a6-b4b12d853ec0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:02:59.662439 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e2fd208a-8512-44e0-8daa-c663ff167bae req-41ae6d82-bb78-4ef7-b4a6-b4b12d853ec0 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 945 time: 0.1044333 Aug 24 03:02:59.711106 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e2fd208a-8512-44e0-8daa-c663ff167bae req-06ffc428-03a1-4b0c-8fea-ee3a9bf273dd tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/security-groups?id=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423026 Aug 24 03:02:59.850735 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-a81884ad-a740-436f-8336-c3cc3f204380 req-968ebb86-384f-48d6-a9fa-7a2283679d03 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:59.862895 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['706be5c2-c6fb-496a-ac91-104e4cc11ae7'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:02:59.878806 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-968ebb86-384f-48d6-a9fa-7a2283679d03 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Pushing event deleted for resources: {'Port': ['ID=706be5c2-c6fb-496a-ac91-104e4cc11ae7,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:02:59.922368 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae293e02-cdd8-4d94-8afd-28b7e52eb07d', 'name': 'network-vif-deleted', 'tag': 'a9477ae9-0c3b-41e5-8ae2-b6d764f9b187'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:02:59.924632 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f48aac7-1c8c-4cf2-8a87-6ed046925754" -d '{"events": [{"server_uuid": "ae293e02-cdd8-4d94-8afd-28b7e52eb07d", "name": "network-vif-deleted", "tag": "a9477ae9-0c3b-41e5-8ae2-b6d764f9b187"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:02:59.928314 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-a81884ad-a740-436f-8336-c3cc3f204380 req-968ebb86-384f-48d6-a9fa-7a2283679d03 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] No DVR routers for this DVR port 706be5c2-c6fb-496a-ac91-104e4cc11ae7 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:02:59.930959 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-a81884ad-a740-436f-8336-c3cc3f204380 req-968ebb86-384f-48d6-a9fa-7a2283679d03 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:02:59.933376 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a81884ad-a740-436f-8336-c3cc3f204380 req-968ebb86-384f-48d6-a9fa-7a2283679d03 tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.43 "DELETE /v2.0/ports/706be5c2-c6fb-496a-ac91-104e4cc11ae7 HTTP/1.1" status: 204 len: 173 time: 0.6124699 Aug 24 03:02:59.994144 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:02:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eed2b8fc-eae4-47f6-9ee1-8ae8a0377bd7 x-openstack-request-id: req-eed2b8fc-eae4-47f6-9ee1-8ae8a0377bd7 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:02:59.994144 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae293e02-cdd8-4d94-8afd-28b7e52eb07d", "name": "network-vif-deleted", "tag": "a9477ae9-0c3b-41e5-8ae2-b6d764f9b187", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:02:59.994144 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-eed2b8fc-eae4-47f6-9ee1-8ae8a0377bd7 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:02:59.994144 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae293e02-cdd8-4d94-8afd-28b7e52eb07d', 'name': 'network-vif-deleted', 'tag': 'a9477ae9-0c3b-41e5-8ae2-b6d764f9b187', 'status': 'completed', 'code': 200} Aug 24 03:03:00.097961 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-534b5c81-e608-4511-98f9-129449dff97b req-f71d40f1-4c6b-4fb5-98d2-084d946693ed tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:00.099471 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-534b5c81-e608-4511-98f9-129449dff97b req-f71d40f1-4c6b-4fb5-98d2-084d946693ed tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 943 time: 0.0511270 Aug 24 03:03:00.136247 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-534b5c81-e608-4511-98f9-129449dff97b req-6a6a0db4-9a17-4e5d-a0e2-67c917ef7f97 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309041 Aug 24 03:03:00.294541 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3c7947ea-8f8e-4364-a37a-0ecb0d6f1fc6 req-a072bd9c-059e-4432-a85f-b4ed6cda8028 tempest-VolumesSnapshotTestJSON-1835766444 tempest-VolumesSnapshotTestJSON-1835766444-project] 10.222.0.30 "GET /v2.0/ports?device_id=ae293e02-cdd8-4d94-8afd-28b7e52eb07d HTTP/1.1" status: 200 len: 210 time: 0.0295997 Aug 24 03:03:00.424016 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a2f585-f4e4-4e03-bbcf-3c9c873051b9 req-58d451d9-b6e6-4596-9942-0ece1168062e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:00.425492 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a7a2f585-f4e4-4e03-bbcf-3c9c873051b9 req-58d451d9-b6e6-4596-9942-0ece1168062e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0530319 Aug 24 03:03:00.464018 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a7a2f585-f4e4-4e03-bbcf-3c9c873051b9 req-b618e0b7-df91-4aa5-8e5a-c1d28e27b05b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0320606 Aug 24 03:03:00.818820 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2f6ac032-3d00-49f6-b577-b66ebfb524fc req-abfe02c1-759a-4375-88a1-3266eae31cdf tempest-ServerRescueNegativeTestJSON-1138030576 tempest-ServerRescueNegativeTestJSON-1138030576-project] 10.222.0.30 "GET /v2.0/ports?device_id=89e6a64a-7412-4541-8c8b-5e9959ae0654 HTTP/1.1" status: 200 len: 210 time: 0.0261235 Aug 24 03:03:00.967804 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:03:00.990387 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:03:00.990735 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device a9477ae9-0c3b-41e5-8ae2-b6d764f9b187 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:03:01.254212 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f73424a-0c4a-4980-969c-1069bcd4d38d req-db4e6f12-f3aa-46c7-bebf-0806146ccba7 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:01.255890 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0f73424a-0c4a-4980-969c-1069bcd4d38d req-db4e6f12-f3aa-46c7-bebf-0806146ccba7 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 943 time: 0.0531473 Aug 24 03:03:01.315677 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0f73424a-0c4a-4980-969c-1069bcd4d38d req-6aa9ed18-7ec7-4d73-9e19-d22b89e47a80 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517988 Aug 24 03:03:01.323766 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0467e6e5-3dec-4513-bad4-1cb5e65ef29b req-81a7150d-2177-4b74-aee0-9c535ac6a7f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:01.325254 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0467e6e5-3dec-4513-bad4-1cb5e65ef29b req-81a7150d-2177-4b74-aee0-9c535ac6a7f4 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=6b319ec439ef48f18d76e47df6300bc6&device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 1099 time: 0.0685041 Aug 24 03:03:01.419054 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0467e6e5-3dec-4513-bad4-1cb5e65ef29b req-43a0fc11-a1b2-4856-92ba-e2c2026bdbca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:01.420442 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0467e6e5-3dec-4513-bad4-1cb5e65ef29b req-43a0fc11-a1b2-4856-92ba-e2c2026bdbca service neutron] 10.222.0.43 "GET /v2.0/networks?id=72400947-ffa3-49a8-8805-03fdb89d0cfb HTTP/1.1" status: 200 len: 918 time: 0.0880444 Aug 24 03:03:01.485276 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0467e6e5-3dec-4513-bad4-1cb5e65ef29b req-ddbbe32d-337d-4feb-b854-18cc978664fc service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=881a8667-42c4-4263-84c5-a172725c834f HTTP/1.1" status: 200 len: 1001 time: 0.0578356 Aug 24 03:03:01.534439 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0467e6e5-3dec-4513-bad4-1cb5e65ef29b req-2f23e7f0-2dae-4737-b144-3002b4ba8f57 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:01.536040 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0467e6e5-3dec-4513-bad4-1cb5e65ef29b req-2f23e7f0-2dae-4737-b144-3002b4ba8f57 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=465e9b83-ccde-4ea3-8e80-86590891b03c HTTP/1.1" status: 200 len: 856 time: 0.0442891 Aug 24 03:03:01.610542 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0232b7d-c872-41ba-a77b-6d13b3f9a089 req-cbd34259-3685-40d4-bf74-4ec0d2fca2be tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:01.611996 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c0232b7d-c872-41ba-a77b-6d13b3f9a089 req-cbd34259-3685-40d4-bf74-4ec0d2fca2be tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0752468 Aug 24 03:03:01.614635 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0467e6e5-3dec-4513-bad4-1cb5e65ef29b req-8d1209a6-70f0-4f6d-8f11-6985ad8c5a2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:01.615795 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0467e6e5-3dec-4513-bad4-1cb5e65ef29b req-8d1209a6-70f0-4f6d-8f11-6985ad8c5a2e service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=72400947-ffa3-49a8-8805-03fdb89d0cfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0710392 Aug 24 03:03:01.698541 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c0232b7d-c872-41ba-a77b-6d13b3f9a089 req-50189457-0892-4f3d-94d8-ff544073109f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0802240 Aug 24 03:03:01.729002 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0467e6e5-3dec-4513-bad4-1cb5e65ef29b req-622cfcd9-67f6-4214-bae0-0433991a9158 service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1048684 Aug 24 03:03:01.876072 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 36594) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:01.994793 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '89e6a64a-7412-4541-8c8b-5e9959ae0654', 'name': 'network-vif-deleted', 'tag': '706be5c2-c6fb-496a-ac91-104e4cc11ae7'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:03:01.997101 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e3c433e-c221-479c-b976-63900ecfaf69" -d '{"events": [{"server_uuid": "89e6a64a-7412-4541-8c8b-5e9959ae0654", "name": "network-vif-deleted", "tag": "706be5c2-c6fb-496a-ac91-104e4cc11ae7"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:03:02.040071 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:03:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-72ef3734-159a-4b6d-80ec-7b2422329700 x-openstack-request-id: req-72ef3734-159a-4b6d-80ec-7b2422329700 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:03:02.040384 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "89e6a64a-7412-4541-8c8b-5e9959ae0654", "name": "network-vif-deleted", "tag": "706be5c2-c6fb-496a-ac91-104e4cc11ae7", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:03:02.040596 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-72ef3734-159a-4b6d-80ec-7b2422329700 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:03:02.040972 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '89e6a64a-7412-4541-8c8b-5e9959ae0654', 'name': 'network-vif-deleted', 'tag': '706be5c2-c6fb-496a-ac91-104e4cc11ae7', 'status': 'completed', 'code': 200} Aug 24 03:03:02.077001 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0467e6e5-3dec-4513-bad4-1cb5e65ef29b req-92497753-8899-4d57-8e51-532fb60a2fb4 service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3398509 Aug 24 03:03:02.516651 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f36775a-32ed-4a68-926f-df171913fa18 req-4c933da8-06a1-49d2-b44f-4b7ccbdbc678 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:02.518136 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5f36775a-32ed-4a68-926f-df171913fa18 req-4c933da8-06a1-49d2-b44f-4b7ccbdbc678 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 943 time: 0.0708933 Aug 24 03:03:02.537478 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-566649'] for router_interface, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:02.611364 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5f36775a-32ed-4a68-926f-df171913fa18 req-f6033d98-d902-417a-93a7-bff74657678b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0855348 Aug 24 03:03:02.816601 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2b8622e-6523-4019-97ba-27e319d8e1d5 req-0f19eeb6-a728-461f-a8e0-5a2d6d8e187f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:02.818729 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f2b8622e-6523-4019-97ba-27e319d8e1d5 req-0f19eeb6-a728-461f-a8e0-5a2d6d8e187f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 946 time: 0.0486314 Aug 24 03:03:02.857825 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f2b8622e-6523-4019-97ba-27e319d8e1d5 req-aa6c22cf-34f9-4c1a-a0b6-bfee60142fe2 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0320978 Aug 24 03:03:02.858925 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Deleting port a332ba93-3521-4c39-a926-54e86542086b {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:03:02.859264 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:02.935766 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] For port a332ba93-3521-4c39-a926-54e86542086b, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=a332ba93-3521-4c39-a926-54e86542086b,segment=NetworkSegment(ce2978d1-5398-4e68-abb9-9457b1c81992),segment_id=ce2978d1-5398-4e68-abb9-9457b1c81992)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:02.936402 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:02.949270 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Calling delete_port for a332ba93-3521-4c39-a926-54e86542086b owned by network:router_interface {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:03:02.988693 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 706be5c2-c6fb-496a-ac91-104e4cc11ae7 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:03:03.009349 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 706be5c2-c6fb-496a-ac91-104e4cc11ae7 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:03:03.009742 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 706be5c2-c6fb-496a-ac91-104e4cc11ae7 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:03:03.010156 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 881a8667-42c4-4263-84c5-a172725c834f no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:03:03.086679 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:03.111745 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '881a8667-42c4-4263-84c5-a172725c834f'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:03:03.115624 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6c6de526-f521-4c45-9d9a-78e49f9ab1a8" -d '{"events": [{"server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "name": "network-vif-unplugged", "status": "completed", "tag": "881a8667-42c4-4263-84c5-a172725c834f"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:03:03.128092 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=881a8667-42c4-4263-84c5-a172725c834f,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:03.152086 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 24 Aug 2021 03:03:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a743118b-caa5-437f-b09b-da08bf9d8ecd x-openstack-request-id: req-a743118b-caa5-437f-b09b-da08bf9d8ecd {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:03:03.152403 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "name": "network-vif-unplugged", "status": "completed", "tag": "881a8667-42c4-4263-84c5-a172725c834f", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:03:03.152659 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-a743118b-caa5-437f-b09b-da08bf9d8ecd {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:03:03.153036 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '881a8667-42c4-4263-84c5-a172725c834f', 'code': 200} Aug 24 03:03:03.244665 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:03.294988 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=881a8667-42c4-4263-84c5-a172725c834f,revision_number=8']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:03.302497 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:03.327995 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Pushing event deleted for resources: {'Port': ['ID=a332ba93-3521-4c39-a926-54e86542086b,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:03.339043 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:03.339393 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:03.339735 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:03.340069 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:03.340401 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:03.340734 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:03.341064 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:03.341387 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:03.341745 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:03.342067 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:03.342387 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:03.342705 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:03.491076 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-748285', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-566109'] for router_interface, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:03.701786 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Router f74a791c-18bb-4c9b-8c5c-f142e02c120a has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:03:03.733387 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ddea28-9725-449d-bba9-8ef85be99f23 req-4c4ad06d-dadb-4cf7-beb2-86650959b6a8 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:03.735055 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-54ddea28-9725-449d-bba9-8ef85be99f23 req-4c4ad06d-dadb-4cf7-beb2-86650959b6a8 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 943 time: 0.0546269 Aug 24 03:03:03.774191 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-54ddea28-9725-449d-bba9-8ef85be99f23 req-3772dbe3-0a91-469c-bc1e-862e338fad49 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322475 Aug 24 03:03:03.814365 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:03:03.819912 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-302684d8-f4a9-4c20-9764-c93bcc94dfa6 admin admin] 10.222.0.30 "PUT /v2.0/routers/f74a791c-18bb-4c9b-8c5c-f142e02c120a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9427681 Aug 24 03:03:03.822710 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 36614) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:03.825381 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ebecbd6-1aae-438e-afe5-332aa7ad9d69 None None] Sync routers for ids ['f74a791c-18bb-4c9b-8c5c-f142e02c120a'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:03:03.835239 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ebecbd6-1aae-438e-afe5-332aa7ad9d69 None None] Routers {'f74a791c-18bb-4c9b-8c5c-f142e02c120a'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:03:03.835983 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-0ebecbd6-1aae-438e-afe5-332aa7ad9d69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:02:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['f74a791c-18bb-4c9b-8c5c-f142e02c120a'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:03.931406 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Notify callbacks [] for router, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:03.941122 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-0ebecbd6-1aae-438e-afe5-332aa7ad9d69 None None] Set router f74a791c-18bb-4c9b-8c5c-f142e02c120a gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:03:03.985072 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6198783-71cc-4587-9825-959e1a333601 req-3012a4b3-c61c-4545-b5d2-65e46ea97d7f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:03.987263 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f6198783-71cc-4587-9825-959e1a333601 req-3012a4b3-c61c-4545-b5d2-65e46ea97d7f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0536478 Aug 24 03:03:04.028697 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f6198783-71cc-4587-9825-959e1a333601 req-f305aabc-f9a2-44ea-b574-fd061d7c8c96 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0352197 Aug 24 03:03:04.049766 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:04.123713 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-0ebecbd6-1aae-438e-afe5-332aa7ad9d69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'name': 'tempest-ServerRescueNegativeTestJSON-420279518-router', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160'}], 'enable_snat': True}, 'gw_port_id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T03:03:03Z', 'revision_number': 5, 'project_id': '174aaeccb001400ca9af9cfc9b1b87be', 'gw_port': {'id': '82349f3d-6f0c-480d-9a25-80618ce4f1c3', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:69:03:cf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.160', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:04.152222 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ebecbd6-1aae-438e-afe5-332aa7ad9d69 None None] Checking router: f74a791c-18bb-4c9b-8c5c-f142e02c120a for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:03:04.160185 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ebecbd6-1aae-438e-afe5-332aa7ad9d69 None None] Routers {'f74a791c-18bb-4c9b-8c5c-f142e02c120a'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:03:04.161365 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-0ebecbd6-1aae-438e-afe5-332aa7ad9d69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:02:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['f74a791c-18bb-4c9b-8c5c-f142e02c120a'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:04.178260 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Deleting port 82349f3d-6f0c-480d-9a25-80618ce4f1c3 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:03:04.178593 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:04.243840 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-0ebecbd6-1aae-438e-afe5-332aa7ad9d69 None None] Set router f74a791c-18bb-4c9b-8c5c-f142e02c120a gateway port host: None {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:03:04.255697 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] For port 82349f3d-6f0c-480d-9a25-80618ce4f1c3, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=82349f3d-6f0c-480d-9a25-80618ce4f1c3,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:04.256064 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:04.267433 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Calling delete_port for 82349f3d-6f0c-480d-9a25-80618ce4f1c3 owned by network:router_gateway {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:03:04.295212 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-0ebecbd6-1aae-438e-afe5-332aa7ad9d69 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'name': 'tempest-ServerRescueNegativeTestJSON-420279518-router', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T03:03:04Z', 'revision_number': 6, 'project_id': '174aaeccb001400ca9af9cfc9b1b87be', 'gw_port_host': None}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:04.324475 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ebecbd6-1aae-438e-afe5-332aa7ad9d69 None None] The sync data for ids ['f74a791c-18bb-4c9b-8c5c-f142e02c120a'] in dv-cinder-803748-8-iscsi is: [{'id': 'f74a791c-18bb-4c9b-8c5c-f142e02c120a', 'name': 'tempest-ServerRescueNegativeTestJSON-420279518-router', 'tenant_id': '174aaeccb001400ca9af9cfc9b1b87be', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T03:03:04Z', 'revision_number': 6, 'project_id': '174aaeccb001400ca9af9cfc9b1b87be', 'gw_port_host': None}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:03:04.536152 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:04.565315 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Pushing event deleted for resources: {'Port': ['ID=82349f3d-6f0c-480d-9a25-80618ce4f1c3,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:04.630071 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-569567'] for router_gateway, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:04.733972 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-560207', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32699'] for router, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:04.739624 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:04.888064 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff1d8642-cbd9-4927-8ede-c42d9322d780 req-bd00584e-0008-4bd8-ab85-6c6613a5df73 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:04.889530 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ff1d8642-cbd9-4927-8ede-c42d9322d780 req-bd00584e-0008-4bd8-ab85-6c6613a5df73 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 943 time: 0.0494971 Aug 24 03:03:04.897682 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557756'] for router, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:04.898210 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router f74a791c-18bb-4c9b-8c5c-f142e02c120a {{(pid=111276) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Aug 24 03:03:04.907220 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] Notify callbacks [] for router, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:04.908266 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-abfbc82c-c46f-4531-8629-da3c334ba2c3 admin admin] 10.222.0.30 "DELETE /v2.0/routers/f74a791c-18bb-4c9b-8c5c-f142e02c120a HTTP/1.1" status: 204 len: 168 time: 1.0842788 Aug 24 03:03:04.910952 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 36624) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:04.935245 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ff1d8642-cbd9-4927-8ede-c42d9322d780 req-e15a1082-068d-4729-9a5c-6512ad305ed5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391519 Aug 24 03:03:04.955284 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-f1e17055-594a-409f-9ce0-707c0b30ef26 admin admin] Deleting subnet 4f536c4e-b790-4630-bdc6-867501285c32 {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:03:04.958423 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f1e17055-594a-409f-9ce0-707c0b30ef26 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:04.990989 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f1e17055-594a-409f-9ce0-707c0b30ef26 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:05.027383 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f1e17055-594a-409f-9ce0-707c0b30ef26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:05.143320 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device a332ba93-3521-4c39-a926-54e86542086b no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:03:05.162192 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b01ab4e-7be3-400b-8904-73c67d247117 req-281f8f75-892c-4b79-a75d-2ecc939d9b44 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:05.168606 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9b01ab4e-7be3-400b-8904-73c67d247117 req-281f8f75-892c-4b79-a75d-2ecc939d9b44 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0490503 Aug 24 03:03:05.168934 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: a332ba93-3521-4c39-a926-54e86542086b {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:03:05.168934 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device a332ba93-3521-4c39-a926-54e86542086b not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:03:05.168934 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 82349f3d-6f0c-480d-9a25-80618ce4f1c3 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:03:05.186186 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: 82349f3d-6f0c-480d-9a25-80618ce4f1c3 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:03:05.186533 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 82349f3d-6f0c-480d-9a25-80618ce4f1c3 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:03:05.213519 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9b01ab4e-7be3-400b-8904-73c67d247117 req-e8f9175d-48fe-4948-ad8b-61e80a0a82ea tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0431950 Aug 24 03:03:05.220144 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f1e17055-594a-409f-9ce0-707c0b30ef26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:05.246424 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1e17055-594a-409f-9ce0-707c0b30ef26 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4f536c4e-b790-4630-bdc6-867501285c32,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:05.248372 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f1e17055-594a-409f-9ce0-707c0b30ef26 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:05.250236 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-f1e17055-594a-409f-9ce0-707c0b30ef26 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/4f536c4e-b790-4630-bdc6-867501285c32 HTTP/1.1" status: 204 len: 168 time: 0.3382680 Aug 24 03:03:05.253037 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 36630) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:05.334386 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:05.417699 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:05.428027 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4091852f-86f8-4dac-87af-44624502a74d']}} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:05.438412 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ce2978d1-5398-4e68-abb9-9457b1c81992') {'for_net_delete': True} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:05.438708 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ce2978d1-5398-4e68-abb9-9457b1c81992') {} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:05.448084 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25761368'] for segment, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:05.461714 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:05.467313 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] Releasing vlan 382 on physical network physnet1 to pool {{(pid=111276) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3525699'] for segment, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: Traceback (most recent call last): Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: timer() Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: cb(*args, **kw) Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: return func(*args, **kwargs) Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: self._notify() Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: self.callback(batched_events) Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: event.method(event) Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: return f(self, *a, **k) Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._get(url).json() Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: return self.request(url, 'GET', **kwargs) Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:03:05.469849 dv-cinder-803748-8-iscsi neutron-server[111276]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:03:05.633685 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:05.639127 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:05.646334 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] 10.222.0.30 "DELETE /v2.0/networks/4091852f-86f8-4dac-87af-44624502a74d HTTP/1.1" status: 204 len: 168 time: 0.3869057 Aug 24 03:03:05.652700 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cd71ff9-7d15-4195-b66d-31b1cb507a0a admin admin] Pushing event deleted for resources: {'Network': ['ID=4091852f-86f8-4dac-87af-44624502a74d,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:06.048480 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-565434e1-e77e-428b-bbb0-b6f1386d3c36 req-f818f59b-1d46-494e-9fe9-a4373d9c2dfa tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:06.049970 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-565434e1-e77e-428b-bbb0-b6f1386d3c36 req-f818f59b-1d46-494e-9fe9-a4373d9c2dfa tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 943 time: 0.0473635 Aug 24 03:03:06.088693 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-565434e1-e77e-428b-bbb0-b6f1386d3c36 req-f29626ae-8bb0-4ffd-9940-9412af159be0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320566 Aug 24 03:03:06.183496 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 36644) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:06.224788 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-f7927852-1467-4713-af9e-c6992e20e6f2 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=174aaeccb001400ca9af9cfc9b1b87be&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0400302 Aug 24 03:03:06.227255 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 36648) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:06.276696 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-6c26f2de-f41f-4152-93ae-1c7d81b02ba8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:06.296756 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-6c26f2de-f41f-4152-93ae-1c7d81b02ba8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:06.410189 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-6c26f2de-f41f-4152-93ae-1c7d81b02ba8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:06.413797 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-6c26f2de-f41f-4152-93ae-1c7d81b02ba8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:06.414988 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-6c26f2de-f41f-4152-93ae-1c7d81b02ba8 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/687bdfdc-45a0-4f37-ba90-1c8ce2b09e87 HTTP/1.1" status: 204 len: 168 time: 0.1868026 Aug 24 03:03:06.422807 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c26f2de-f41f-4152-93ae-1c7d81b02ba8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=687bdfdc-45a0-4f37-ba90-1c8ce2b09e87,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:07.008394 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 881a8667-42c4-4263-84c5-a172725c834f no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:03:07.013308 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd7b92f5-bee2-49c3-8e83-5317768cab25 req-d805fab3-c727-49b7-8429-5f55b1877584 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:07.014884 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fd7b92f5-bee2-49c3-8e83-5317768cab25 req-d805fab3-c727-49b7-8429-5f55b1877584 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0565226 Aug 24 03:03:07.060057 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fd7b92f5-bee2-49c3-8e83-5317768cab25 req-87494c40-3427-435a-beff-fed77a952d1d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0388749 Aug 24 03:03:07.209081 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b43d2c-83a2-475a-894d-414caac3fd15 req-7413e910-ee47-4dbd-8797-804cc8496bd1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:07.210597 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-47b43d2c-83a2-475a-894d-414caac3fd15 req-7413e910-ee47-4dbd-8797-804cc8496bd1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 943 time: 0.0518084 Aug 24 03:03:07.248763 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-47b43d2c-83a2-475a-894d-414caac3fd15 req-4aa69053-b2f7-4f1b-8ff1-410534d7f9db tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316596 Aug 24 03:03:07.612107 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 36700) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:07.641378 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 36704) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:07.721836 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1785327958-network', 'tenant_id': '18e124ea63a5483aba6b8f112a4d4b33'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:07.754025 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-8a138f31-c733-4dc9-a719-c3e6b93e90b3 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1075797 Aug 24 03:03:07.821993 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Made reservation on behalf of 18e124ea63a5483aba6b8f112a4d4b33 for: {'network': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:03:07.824382 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:07.834350 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:07.928948 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:08.102151 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:08.127025 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] vlan segment allocate from pool success with {'vlan_id': 382, 'physical_network': 'physnet1'} {{(pid=111276) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:03:08.147253 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c016b3ff-8807-4c30-acdd-3519191539dd,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:08.163282 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:08.163282 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.segments_db [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Added segment 265560af-a3e0-4c25-85a0-de528164f111 of type vlan for network a8a02a2d-c194-4f2f-9653-b6e128589efc Aug 24 03:03:08.232557 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d8bcd89-d36d-474f-94f2-966a5a8d5e2e req-8b1e3ced-c115-4a12-b9a1-cb8ff586aa47 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:08.234056 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4d8bcd89-d36d-474f-94f2-966a5a8d5e2e req-8b1e3ced-c115-4a12-b9a1-cb8ff586aa47 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0986063 Aug 24 03:03:08.235549 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:08.288839 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4d8bcd89-d36d-474f-94f2-966a5a8d5e2e req-3ccc2da1-1955-40a4-939d-319929c03795 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0476193 Aug 24 03:03:08.369600 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c71966-5820-430e-a3db-c78bac8b91c7 req-a27af04e-ed0e-4e6e-af19-8b271bbb3fab tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:08.370999 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-77c71966-5820-430e-a3db-c78bac8b91c7 req-a27af04e-ed0e-4e6e-af19-8b271bbb3fab tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 943 time: 0.0498509 Aug 24 03:03:08.399100 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:08.400097 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:08.400686 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:08.409027 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-77c71966-5820-430e-a3db-c78bac8b91c7 req-3c28cbc2-a503-4850-908e-f32a34faa50d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319450 Aug 24 03:03:08.468818 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] Pushing event updated for resources: {'Network': ['ID=a8a02a2d-c194-4f2f-9653-b6e128589efc,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:08.475655 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network a8a02a2d-c194-4f2f-9653-b6e128589efc details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:03:08.525251 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-f826b84e-93b5-4fc8-bd18-0cd4b24d8ac2 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.9120193 Aug 24 03:03:08.534004 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 36724) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:08.539145 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-859fbcef-8316-4c66-a9c6-bf247dae9888 admin admin] Request body: {'subnet': {'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1785327958-subnet', 'tenant_id': '18e124ea63a5483aba6b8f112a4d4b33', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:08.639269 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-859fbcef-8316-4c66-a9c6-bf247dae9888 admin admin] Made reservation on behalf of 18e124ea63a5483aba6b8f112a4d4b33 for: {'subnet': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:03:08.641197 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:08.644459 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-859fbcef-8316-4c66-a9c6-bf247dae9888 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25854793'] for subnet, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:08.959563 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-859fbcef-8316-4c66-a9c6-bf247dae9888 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3523558', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25854779'] for subnet, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:09.016722 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-859fbcef-8316-4c66-a9c6-bf247dae9888 admin admin] Pushing event updated for resources: {'Subnet': ['ID=05cef140-037d-459e-a03d-a6915273f9d4,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:09.026140 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 894657b8-22e4-4340-af94-46bb6d84e3d7 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:03:09.026897 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-859fbcef-8316-4c66-a9c6-bf247dae9888 admin admin] Checking segment: {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:03:09.027018 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-859fbcef-8316-4c66-a9c6-bf247dae9888 admin admin] Network hostable DHCP agents. Network: a8a02a2d-c194-4f2f-9653-b6e128589efc, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111276) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:03:09.125416 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 894657b8-22e4-4340-af94-46bb6d84e3d7, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=894657b8-22e4-4340-af94-46bb6d84e3d7,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:09.136644 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '894657b8-22e4-4340-af94-46bb6d84e3d7', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'port_id': '894657b8-22e4-4340-af94-46bb6d84e3d7', 'mac_address': 'fa:16:3e:e7:7a:32', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 385, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:03:09.175991 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:09.187414 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-859fbcef-8316-4c66-a9c6-bf247dae9888 admin admin] Network a8a02a2d-c194-4f2f-9653-b6e128589efc is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111276) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:03:09.189341 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 894657b8-22e4-4340-af94-46bb6d84e3d7 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:03:09.209785 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 894657b8-22e4-4340-af94-46bb6d84e3d7, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=894657b8-22e4-4340-af94-46bb6d84e3d7,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:09.317140 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-859fbcef-8316-4c66-a9c6-bf247dae9888 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, a8a02a2d-c194-4f2f-9653-b6e128589efc) {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:09.321479 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-859fbcef-8316-4c66-a9c6-bf247dae9888 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:09.322070 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-859fbcef-8316-4c66-a9c6-bf247dae9888 admin admin] Notify callbacks [] for subnet, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:09.327193 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-733af42d-4b61-4a1f-94e7-7f219871fb18 None None] Network a8a02a2d-c194-4f2f-9653-b6e128589efc requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:03:09.371660 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:09.413212 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa359379-2be9-4784-a541-39722dfb975b req-4b0121e8-7ce1-434c-a5eb-abebcca2ad1e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:09.414765 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-aa359379-2be9-4784-a541-39722dfb975b req-4b0121e8-7ce1-434c-a5eb-abebcca2ad1e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0492542 Aug 24 03:03:09.443814 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-859fbcef-8316-4c66-a9c6-bf247dae9888 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.9086952 Aug 24 03:03:09.455478 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=894657b8-22e4-4340-af94-46bb6d84e3d7,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:09.466552 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-aa359379-2be9-4784-a541-39722dfb975b req-1355c387-1769-47f8-889d-1ae58ef1ac3a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0451622 Aug 24 03:03:09.468950 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:09.469376 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:09.469666 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:09.470005 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:09.470353 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:09.470689 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:09.471020 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:09.471347 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:09.471679 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:09.472000 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:09.472513 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:09.472833 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:09.528763 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8d85516-3df6-4e45-b6c9-40a12c8c9dde None None] Network a8a02a2d-c194-4f2f-9653-b6e128589efc requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:03:09.552751 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16ca2a89-0601-4e1d-95b9-e70f7a86da22 req-f8cff714-abe9-4712-976c-44f65f09ffc5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:09.554303 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-16ca2a89-0601-4e1d-95b9-e70f7a86da22 req-f8cff714-abe9-4712-976c-44f65f09ffc5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 944 time: 0.0580032 Aug 24 03:03:09.592653 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['894657b8-22e4-4340-af94-46bb6d84e3d7'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:03:09.607871 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-16ca2a89-0601-4e1d-95b9-e70f7a86da22 req-d1ede63c-1193-42de-ac08-fe82e722a12c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439482 Aug 24 03:03:09.947391 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-12220060-2a4f-4770-8788-f0c47ad7e605 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:09.949319 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-12220060-2a4f-4770-8788-f0c47ad7e605 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/networks?id=a8a02a2d-c194-4f2f-9653-b6e128589efc HTTP/1.1" status: 200 len: 815 time: 0.1105151 Aug 24 03:03:09.965299 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-7be3672c-49ec-457e-a7b6-fbf533ebc4f4 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/quotas/18e124ea63a5483aba6b8f112a4d4b33 HTTP/1.1" status: 200 len: 375 time: 0.0094852 Aug 24 03:03:09.998580 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-4e15912a-3a71-4730-8f5f-c7ae2a7a139a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0269580 Aug 24 03:03:10.091727 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-eb9825aa-3e73-4d71-9393-4b57e452534d service neutron] 10.222.0.30 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851693 Aug 24 03:03:10.179752 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-010cd7f4-2b6f-453d-abbf-15f4f5a5d32e service neutron] 10.222.0.30 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819113 Aug 24 03:03:10.424220 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-dc68190a-93df-4385-87bd-b7cde67d5a97 req-908531cb-80f1-4ef8-98a9-d90f29e76eb0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0291870 Aug 24 03:03:10.605178 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89cbb5d5-9694-45fa-ade5-d83a50ad51a1 req-466a18c1-beff-47d5-a28d-2d9ca951aa5b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:10.606681 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-89cbb5d5-9694-45fa-ade5-d83a50ad51a1 req-466a18c1-beff-47d5-a28d-2d9ca951aa5b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0496337 Aug 24 03:03:10.651361 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-89cbb5d5-9694-45fa-ade5-d83a50ad51a1 req-b5f533c2-dba6-4043-bad1-4ea02cbd71be tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0382867 Aug 24 03:03:10.752162 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcfbe1b2-1b72-489c-9a7c-5e57b88cf2a1 req-4befff29-2d61-4924-a7aa-c8a622cd1c59 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:10.753615 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-dcfbe1b2-1b72-489c-9a7c-5e57b88cf2a1 req-4befff29-2d61-4924-a7aa-c8a622cd1c59 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 944 time: 0.0483420 Aug 24 03:03:10.791810 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-dcfbe1b2-1b72-489c-9a7c-5e57b88cf2a1 req-b9a0fa70-7519-499b-ace4-87de8425fd58 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320480 Aug 24 03:03:11.041827 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 894657b8-22e4-4340-af94-46bb6d84e3d7 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:11.084142 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-2e2f92b4-8ede-4ba9-a0cc-fa9ea6ea2151 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:11.086327 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-2e2f92b4-8ede-4ba9-a0cc-fa9ea6ea2151 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6&tenant_id=6b319ec439ef48f18d76e47df6300bc6 HTTP/1.1" status: 200 len: 1097 time: 0.0879073 Aug 24 03:03:11.147714 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-e67250b4-8d76-4b42-9310-68dfce0a59a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:11.149216 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-e67250b4-8d76-4b42-9310-68dfce0a59a2 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=6b319ec439ef48f18d76e47df6300bc6&device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 1097 time: 0.0395596 Aug 24 03:03:11.241167 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-42391fa8-69bd-430a-959e-b9d544ba6664 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:11.242660 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-42391fa8-69bd-430a-959e-b9d544ba6664 service neutron] 10.222.0.43 "GET /v2.0/networks?id=72400947-ffa3-49a8-8805-03fdb89d0cfb HTTP/1.1" status: 200 len: 918 time: 0.0868924 Aug 24 03:03:11.322596 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-76c1870a-2acb-4557-bc74-c825f0fd4b4f service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=881a8667-42c4-4263-84c5-a172725c834f HTTP/1.1" status: 200 len: 999 time: 0.0603540 Aug 24 03:03:11.359745 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-da723824-8e3f-40cf-b3c4-72d5ddf643f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:11.361343 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-da723824-8e3f-40cf-b3c4-72d5ddf643f6 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=465e9b83-ccde-4ea3-8e80-86590891b03c HTTP/1.1" status: 200 len: 856 time: 0.0434773 Aug 24 03:03:11.373241 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 894657b8-22e4-4340-af94-46bb6d84e3d7 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:11.373241 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 894657b8-22e4-4340-af94-46bb6d84e3d7 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:11.373241 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:11.413909 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-a5228a12-5bed-45e4-89e7-10958f9cee97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:11.415405 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-a5228a12-5bed-45e4-89e7-10958f9cee97 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=72400947-ffa3-49a8-8805-03fdb89d0cfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0473514 Aug 24 03:03:11.448090 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:11.472955 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '894657b8-22e4-4340-af94-46bb6d84e3d7'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:03:11.475787 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e9c67fd-d7f2-4677-96e3-69a9132ff9c6" -d '{"events": [{"server_uuid": "07edef45-7d42-46a0-89b8-2a6e24a64a16", "name": "network-vif-plugged", "status": "completed", "tag": "894657b8-22e4-4340-af94-46bb6d84e3d7"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:03:11.490368 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 894657b8-22e4-4340-af94-46bb6d84e3d7, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=894657b8-22e4-4340-af94-46bb6d84e3d7,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:11.511283 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-730f39da-a610-46b5-b260-416c6d5e4897 req-1534d5ae-c486-4725-94a6-c7a9aa020c69 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0299540 Aug 24 03:03:11.513759 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-5ef7f424-57a4-4587-9326-f4c9425fd658 service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0902891 Aug 24 03:03:11.559015 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:03:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-495442f7-6a6c-4a93-acfc-29726f93ff62 x-openstack-request-id: req-495442f7-6a6c-4a93-acfc-29726f93ff62 {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:03:11.559307 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "07edef45-7d42-46a0-89b8-2a6e24a64a16", "name": "network-vif-plugged", "status": "completed", "tag": "894657b8-22e4-4340-af94-46bb6d84e3d7", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:03:11.559560 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-495442f7-6a6c-4a93-acfc-29726f93ff62 {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:03:11.559946 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '894657b8-22e4-4340-af94-46bb6d84e3d7', 'code': 200} Aug 24 03:03:11.609660 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d118aeed-a650-4673-908f-8742a7fd3b2e req-72ba385c-677a-42d2-bc5d-16e501d6e405 service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882497 Aug 24 03:03:11.621999 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:11.671806 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=894657b8-22e4-4340-af94-46bb6d84e3d7,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:11.800102 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-839438b3-0428-423e-90e7-4f041f90d034 req-97f27e51-fdbc-4c11-8f35-003cf848c831 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:11.801728 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-839438b3-0428-423e-90e7-4f041f90d034 req-97f27e51-fdbc-4c11-8f35-003cf848c831 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0669248 Aug 24 03:03:11.853702 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-839438b3-0428-423e-90e7-4f041f90d034 req-bd38e306-9096-4ec2-86df-109169245a5a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0452945 Aug 24 03:03:11.928285 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e10fa7bf-8c55-48d5-b90e-119bbe85efaa req-a9b7dd18-cf55-40c8-b322-b53174cd028d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:11.929869 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e10fa7bf-8c55-48d5-b90e-119bbe85efaa req-a9b7dd18-cf55-40c8-b322-b53174cd028d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0524118 Aug 24 03:03:12.009168 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e10fa7bf-8c55-48d5-b90e-119bbe85efaa req-c3e7e2a2-325a-4dd1-accc-0eb92fabf8ad tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0600424 Aug 24 03:03:12.025564 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41059085-7daa-4ba2-906d-9ab5a7b4ea47 req-2e458c53-d383-4c9b-a6db-cb09cd9d00ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:12.027602 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-41059085-7daa-4ba2-906d-9ab5a7b4ea47 req-2e458c53-d383-4c9b-a6db-cb09cd9d00ac service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 1098 time: 0.0480649 Aug 24 03:03:12.064533 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-41059085-7daa-4ba2-906d-9ab5a7b4ea47 req-1ef99127-7279-4a16-b72c-c98ff92b0753 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0276279 Aug 24 03:03:12.656233 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-58e3af12-3d5f-417d-a866-75027991b5b7 req-c3cd3fbc-008d-4bf1-9ba3-8049cddb4e6b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0420859 Aug 24 03:03:13.017121 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d7bc35-9908-4882-99b4-788c9d0f2d26 req-b704a855-8bb3-4979-b4ee-658ec5c47c10 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:13.018612 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f5d7bc35-9908-4882-99b4-788c9d0f2d26 req-b704a855-8bb3-4979-b4ee-658ec5c47c10 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0772815 Aug 24 03:03:13.067461 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f5d7bc35-9908-4882-99b4-788c9d0f2d26 req-d7bcac28-a606-4053-9422-4d9bf89c49e3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0387042 Aug 24 03:03:13.144682 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d55bb6-8737-43f4-8044-b1e66131c9a9 req-d42042af-1076-4d1f-b2ca-97ab018d681f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:13.146764 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-92d55bb6-8737-43f4-8044-b1e66131c9a9 req-d42042af-1076-4d1f-b2ca-97ab018d681f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0511487 Aug 24 03:03:13.187691 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-92d55bb6-8737-43f4-8044-b1e66131c9a9 req-90ebbc1e-7cf7-47ef-91e1-07e3bd599482 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0347996 Aug 24 03:03:13.753303 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c5676f0a-f425-4da2-ab43-2e19f8e8d704 req-b9701ca6-10a5-4f92-8d2f-da29d7efcca2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0253625 Aug 24 03:03:14.178482 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d6462d-55ee-4484-8b33-cb4a919d7950 req-3ce1d109-dcb0-40b3-a108-110390831ca7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:14.180088 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d7d6462d-55ee-4484-8b33-cb4a919d7950 req-3ce1d109-dcb0-40b3-a108-110390831ca7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0497284 Aug 24 03:03:14.219291 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d7d6462d-55ee-4484-8b33-cb4a919d7950 req-068c273a-ab29-4653-9573-bfec889c2189 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0324590 Aug 24 03:03:14.308789 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0f2622f-d245-4dd1-a60a-796757eb8b59 req-9df137be-fffc-48d1-b0e0-d0693985c898 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:14.310552 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a0f2622f-d245-4dd1-a60a-796757eb8b59 req-9df137be-fffc-48d1-b0e0-d0693985c898 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0538907 Aug 24 03:03:14.354727 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a0f2622f-d245-4dd1-a60a-796757eb8b59 req-dac22bf3-1064-4092-8306-2a0b08162145 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381606 Aug 24 03:03:14.851627 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8ba659ce-4333-453d-9468-e7129b82d822 req-eee62cf1-e743-4aec-b23b-9a69f1ca9a8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0281343 Aug 24 03:03:15.338154 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a641be1-29d0-4625-9875-09d2019b6c6c req-1032857f-a4c7-44d5-a1a7-a08ae5edd6d7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:15.339818 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2a641be1-29d0-4625-9875-09d2019b6c6c req-1032857f-a4c7-44d5-a1a7-a08ae5edd6d7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0476379 Aug 24 03:03:15.386780 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2a641be1-29d0-4625-9875-09d2019b6c6c req-c88d7560-c700-4c60-a1dc-e338fff1535e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0407953 Aug 24 03:03:15.478577 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-281435cb-0e49-4725-b303-8876c71fe322 req-37094cf5-f3fc-490c-8c82-3c8a26b478e8 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:15.480061 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-281435cb-0e49-4725-b303-8876c71fe322 req-37094cf5-f3fc-490c-8c82-3c8a26b478e8 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0557568 Aug 24 03:03:15.515987 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-281435cb-0e49-4725-b303-8876c71fe322 req-bf729e22-dcd5-45bd-a0e7-8177ef444a40 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0297022 Aug 24 03:03:15.949884 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cccae3da-c62f-4450-b215-4b7a67af2a09 req-5cfc8dc7-6a79-4080-ad7b-1cc94aab71cb tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0268629 Aug 24 03:03:16.511611 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e7f558c-2e6d-4a34-b11e-041794b4347b req-5bb8bc97-665f-42e0-8fea-d59f9f91f992 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:16.513360 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6e7f558c-2e6d-4a34-b11e-041794b4347b req-5bb8bc97-665f-42e0-8fea-d59f9f91f992 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0541124 Aug 24 03:03:16.552465 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6e7f558c-2e6d-4a34-b11e-041794b4347b req-c223fa72-e46d-48d1-9b28-b02424a64605 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0330234 Aug 24 03:03:16.637729 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39934449-fbe1-4e60-9fa7-7368f8bdad87 req-c524c1bd-995d-4e1f-ac84-2d9421ea710d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:16.639129 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-39934449-fbe1-4e60-9fa7-7368f8bdad87 req-c524c1bd-995d-4e1f-ac84-2d9421ea710d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0549121 Aug 24 03:03:16.679019 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-39934449-fbe1-4e60-9fa7-7368f8bdad87 req-836b9581-173c-4835-87b7-12b936e0bcb9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0335603 Aug 24 03:03:17.046462 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-dc77c929-be08-481b-8280-2efd43ec3020 req-1db7c79f-fca5-4005-aae6-dccf35e58cbe tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0264359 Aug 24 03:03:17.682299 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790dfe9f-9a54-4378-ac84-f4c9d07c3774 req-c99e8b19-72c9-47f2-9ea9-e03d1f95203c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:17.684105 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-790dfe9f-9a54-4378-ac84-f4c9d07c3774 req-c99e8b19-72c9-47f2-9ea9-e03d1f95203c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0550594 Aug 24 03:03:17.730168 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-790dfe9f-9a54-4378-ac84-f4c9d07c3774 req-b16edb9f-d2c2-4dbb-b3d2-4de43e8f6069 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0396094 Aug 24 03:03:17.863213 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d329c69-b2ef-4ec9-8605-96718860bf1f req-1c52d88a-4ce4-4bc6-ad15-74e9c86cc7a3 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:17.865432 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0d329c69-b2ef-4ec9-8605-96718860bf1f req-1c52d88a-4ce4-4bc6-ad15-74e9c86cc7a3 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0877037 Aug 24 03:03:17.912298 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0d329c69-b2ef-4ec9-8605-96718860bf1f req-7c2b43b0-72ba-4317-9836-025841e6e741 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386963 Aug 24 03:03:18.169528 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ae2d30fa-f594-45fc-b980-ec1bf0684c63 req-9e1e845f-935f-457f-bf10-48691d1cb5a0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0326142 Aug 24 03:03:18.878404 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7b6ad0-cc94-465e-a615-d68032276772 req-a012d565-b934-45ee-ac88-4ed7d3cb4108 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:18.880659 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fe7b6ad0-cc94-465e-a615-d68032276772 req-a012d565-b934-45ee-ac88-4ed7d3cb4108 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0540900 Aug 24 03:03:18.920629 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fe7b6ad0-cc94-465e-a615-d68032276772 req-2c2dbbd1-2bab-4a32-8504-d73b5cb96abc tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0338871 Aug 24 03:03:19.042048 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21b75727-0512-45d4-b690-960ab915c675 req-3cd76725-d368-4589-926c-81945567c10b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:19.043503 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-21b75727-0512-45d4-b690-960ab915c675 req-3cd76725-d368-4589-926c-81945567c10b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0537987 Aug 24 03:03:19.088182 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-21b75727-0512-45d4-b690-960ab915c675 req-24b8e0f0-d000-4787-a420-d894dee43135 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383437 Aug 24 03:03:19.277848 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c6d99860-ac35-40b8-b9c2-8a33787978cf req-c256dda7-b1b7-42a3-81f5-55c0d6224cd9 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0283999 Aug 24 03:03:20.047231 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a5db1bc-8bdc-4764-8c89-8a5af3d867c3 req-70d5e977-bd0b-4bfa-8fb6-643d8d6a7ee8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:20.063170 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3a5db1bc-8bdc-4764-8c89-8a5af3d867c3 req-70d5e977-bd0b-4bfa-8fb6-643d8d6a7ee8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0541732 Aug 24 03:03:20.095938 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3a5db1bc-8bdc-4764-8c89-8a5af3d867c3 req-fc5effeb-7197-4742-8f94-e6dd93c33d76 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0384779 Aug 24 03:03:20.212661 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b053239-aac0-4ffc-ae92-77c385cd1524 req-478391ee-0d0f-425f-9741-8b05a40ca7f5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:20.214891 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7b053239-aac0-4ffc-ae92-77c385cd1524 req-478391ee-0d0f-425f-9741-8b05a40ca7f5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0535278 Aug 24 03:03:20.256895 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7b053239-aac0-4ffc-ae92-77c385cd1524 req-36081d3f-f8aa-431f-b82b-aa09a6c78b38 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0362864 Aug 24 03:03:20.373103 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d8f7e20a-7df6-48e2-8dd5-93458ba3dd80 req-00befcd1-1cd4-474c-8270-64eddcbc7416 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0258999 Aug 24 03:03:21.224603 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4518d5e-c990-435b-8e0a-fb3e880bf60d req-f4ef8ead-6995-4ba8-8654-877fa7d29463 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:21.226021 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e4518d5e-c990-435b-8e0a-fb3e880bf60d req-f4ef8ead-6995-4ba8-8654-877fa7d29463 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0486393 Aug 24 03:03:21.275916 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e4518d5e-c990-435b-8e0a-fb3e880bf60d req-39832ef8-b050-4c5b-b495-3ae7a38b3a53 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0426898 Aug 24 03:03:21.396096 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-477767d1-f672-4655-a3fb-7fa67fc47f82 req-bd9bdd5d-2bda-44ec-a7ae-fba485a1a24d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:21.398957 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-477767d1-f672-4655-a3fb-7fa67fc47f82 req-bd9bdd5d-2bda-44ec-a7ae-fba485a1a24d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0635960 Aug 24 03:03:21.411259 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-36aa5415-fdef-48ea-b49a-9d1917bbe38a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:21.445230 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-477767d1-f672-4655-a3fb-7fa67fc47f82 req-fbe97f69-4c38-4cac-ba96-1eed858ab47b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401216 Aug 24 03:03:21.474347 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-86acb732-b0e4-4871-9823-3f9f739ece8d req-da5243f8-6a44-40cb-bb3e-9d0824943e47 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0269287 Aug 24 03:03:22.399898 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3078b380-e6f8-4106-9565-75b2270a85b6 req-b6ba26d5-ddea-4b02-9ff6-f7bf87d6b7b3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:22.401417 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3078b380-e6f8-4106-9565-75b2270a85b6 req-b6ba26d5-ddea-4b02-9ff6-f7bf87d6b7b3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0502989 Aug 24 03:03:22.446566 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3078b380-e6f8-4106-9565-75b2270a85b6 req-ead31d68-8d11-41dc-93b0-3570e2643217 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0391431 Aug 24 03:03:22.574310 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd6f6dd2-fad7-4e71-946a-e14f4d5305f5 req-9407cd01-1d01-4cca-bc8b-7f53dc9291e8 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:22.575767 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-cd6f6dd2-fad7-4e71-946a-e14f4d5305f5 req-9407cd01-1d01-4cca-bc8b-7f53dc9291e8 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0639787 Aug 24 03:03:22.592587 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b104d3f4-03cc-4d62-9248-4c3cdebcae2c req-9a6d3b1a-cd94-47cd-9868-a30c3bfa3d75 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0289874 Aug 24 03:03:22.615073 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-cd6f6dd2-fad7-4e71-946a-e14f4d5305f5 req-1361f44a-fc7d-4c1f-82e0-ede11db14e7e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0328631 Aug 24 03:03:23.569171 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4df77411-fc66-4dd2-87e0-c5081d83f711 req-0b086671-6db2-491c-9a42-b2f840f5ff2b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:23.570642 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4df77411-fc66-4dd2-87e0-c5081d83f711 req-0b086671-6db2-491c-9a42-b2f840f5ff2b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0531962 Aug 24 03:03:23.607413 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4df77411-fc66-4dd2-87e0-c5081d83f711 req-122ef659-cf4f-4e45-acfe-fc853e41d917 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0307598 Aug 24 03:03:23.688233 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1e190ca0-afe9-454d-89c4-c3dc49b70494 req-a7133cb0-b5c7-42ce-bab1-ee7051395aa7 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0291739 Aug 24 03:03:23.737738 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eacd95e-c4f8-4af2-8df6-9e29d6430dd2 req-d8b44bb8-3c02-48ed-ae7a-d0bebef061c0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:23.739325 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3eacd95e-c4f8-4af2-8df6-9e29d6430dd2 req-d8b44bb8-3c02-48ed-ae7a-d0bebef061c0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0505702 Aug 24 03:03:23.776520 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3eacd95e-c4f8-4af2-8df6-9e29d6430dd2 req-172da461-d00a-4d88-87e6-c0c5ac3c721b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0313373 Aug 24 03:03:24.010233 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-81e7b3c0-3f13-4a04-a679-d13b4aafe316 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:24.393120 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:24.571646 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:03:24.729594 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6969388c-8271-439e-9971-d3cacb64b89d req-232e3e59-46ce-4ebb-b84c-d406aa90193b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:24.731075 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6969388c-8271-439e-9971-d3cacb64b89d req-232e3e59-46ce-4ebb-b84c-d406aa90193b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0481172 Aug 24 03:03:24.769215 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6969388c-8271-439e-9971-d3cacb64b89d req-b893a6d4-ba60-48e7-ad78-8586f478ac97 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0320697 Aug 24 03:03:24.870608 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-675e7ac2-2e41-4414-bb66-248178c985bc req-8a89f751-959a-444c-929d-73b16027aeb8 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0315092 Aug 24 03:03:24.910946 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-8007ee3d-7c28-4987-8e97-e04d6a13cc7c tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:24.912407 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-8007ee3d-7c28-4987-8e97-e04d6a13cc7c tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "GET /v2.0/networks?id=a8a02a2d-c194-4f2f-9653-b6e128589efc HTTP/1.1" status: 200 len: 815 time: 0.1248541 Aug 24 03:03:24.927735 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Request body: {'port': {'device_id': 'c1b52e4a-a25e-48b6-a970-280f7ae198b7', 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc', 'admin_state_up': True, 'tenant_id': '18e124ea63a5483aba6b8f112a4d4b33'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:25.035108 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8872d579-ac43-450f-ace7-1aaefcbd49f0 req-3be4bd60-4a6f-4b74-abef-f62d59470f42 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:25.037105 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8872d579-ac43-450f-ace7-1aaefcbd49f0 req-3be4bd60-4a6f-4b74-abef-f62d59470f42 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.1139076 Aug 24 03:03:25.099431 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8872d579-ac43-450f-ace7-1aaefcbd49f0 req-8d720b8d-db19-4548-8943-04d3c4106adc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0544815 Aug 24 03:03:25.187089 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d79b1c40-69dc-47d2-ba7f-6159b00fa066 req-8d9fdddd-c3eb-4a31-8c81-05e492304bd7 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:25.188469 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d79b1c40-69dc-47d2-ba7f-6159b00fa066 req-8d9fdddd-c3eb-4a31-8c81-05e492304bd7 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0482328 Aug 24 03:03:25.193175 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Made reservation on behalf of 18e124ea63a5483aba6b8f112a4d4b33 for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:03:25.197564 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:25.227363 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d79b1c40-69dc-47d2-ba7f-6159b00fa066 req-b8b6b37d-659c-4189-b1dc-19f32ee79710 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325425 Aug 24 03:03:25.328696 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Allocated IP 172.20.0.3 (a8a02a2d-c194-4f2f-9653-b6e128589efc/05cef140-037d-459e-a03d-a6915273f9d4/450b43c8-80f4-420a-a8ae-14a79c1f2644) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:03:25.477054 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:25.553142 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:25.798963 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:25.839640 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Network a8a02a2d-c194-4f2f-9653-b6e128589efc is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:03:25.842575 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:25.846128 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:03:25.885160 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Pushing event updated for resources: {'Port': ['ID=450b43c8-80f4-420a-a8ae-14a79c1f2644,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:25.929694 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:25.930313 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:25.951448 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cb13846-86e5-45a0-93cb-8e3d383c4b9a req-0f803603-8692-4cad-ae55-8abaa4ae0f9c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:25.959356 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6cb13846-86e5-45a0-93cb-8e3d383c4b9a req-0f803603-8692-4cad-ae55-8abaa4ae0f9c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0842888 Aug 24 03:03:25.984586 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b9c1d67-1deb-4150-91d4-6904fb6ab4be req-1b3a6d33-30a4-4765-8796-ba8ba29fcc42 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:25.986066 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7b9c1d67-1deb-4150-91d4-6904fb6ab4be req-1b3a6d33-30a4-4765-8796-ba8ba29fcc42 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 931 time: 0.0498617 Aug 24 03:03:25.995795 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6cb13846-86e5-45a0-93cb-8e3d383c4b9a req-dd72d4ea-50ed-4873-abb9-bdd0461434c7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0325942 Aug 24 03:03:26.014370 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-6d22be22-e449-4b8e-8fc4-62bf4f82fd84 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0921755 Aug 24 03:03:26.026701 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7b9c1d67-1deb-4150-91d4-6904fb6ab4be req-03906af7-59c0-4e2d-bc47-fa6f71cbda51 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328856 Aug 24 03:03:26.026982 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Request body: {'port': {'device_id': 'c1b52e4a-a25e-48b6-a970-280f7ae198b7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:26.079377 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:26.287492 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-483b9185-5440-48f7-8c71-37142a5e1ef0 req-75de7027-0605-4973-a513-851c1e3b4c83 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:26.288959 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-483b9185-5440-48f7-8c71-37142a5e1ef0 req-75de7027-0605-4973-a513-851c1e3b4c83 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.1076217 Aug 24 03:03:26.350674 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014a6370-3a47-4098-a85f-0821af34ffbd req-7404efd9-0389-43a7-91e3-ceeb2c9dda57 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:26.352275 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-014a6370-3a47-4098-a85f-0821af34ffbd req-7404efd9-0389-43a7-91e3-ceeb2c9dda57 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0572934 Aug 24 03:03:26.357556 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-483b9185-5440-48f7-8c71-37142a5e1ef0 req-a3f9886c-9207-4131-8cd2-7ce59101a8b9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0603685 Aug 24 03:03:26.391954 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-014a6370-3a47-4098-a85f-0821af34ffbd req-0578f7f8-fe2a-4cca-8c95-3a9fb76f7891 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0335181 Aug 24 03:03:26.425878 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 450b43c8-80f4-420a-a8ae-14a79c1f2644 {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:03:26.436229 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:26.469727 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Transition to ACTIVE for port object 450b43c8-80f4-420a-a8ae-14a79c1f2644 will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:03:26.489323 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4edfd01-0e3f-4b4a-9f7d-36f9245711f9 req-60911455-b083-4fb7-a7c8-dbd8aa0d9169 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:26.490831 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a4edfd01-0e3f-4b4a-9f7d-36f9245711f9 req-60911455-b083-4fb7-a7c8-dbd8aa0d9169 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0575459 Aug 24 03:03:26.533378 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:26.546543 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a4edfd01-0e3f-4b4a-9f7d-36f9245711f9 req-4e847145-c900-49d3-b06d-5223e60f284c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498698 Aug 24 03:03:26.579002 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 36994) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:26.591075 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Pushing event updated for resources: {'Port': ['ID=450b43c8-80f4-420a-a8ae-14a79c1f2644,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:26.663395 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Attempting to bind port 450b43c8-80f4-420a-a8ae-14a79c1f2644 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:03:26.663736 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Attempting to bind port 450b43c8-80f4-420a-a8ae-14a79c1f2644 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:03:26.664143 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Attempting to bind port 450b43c8-80f4-420a-a8ae-14a79c1f2644 on network a8a02a2d-c194-4f2f-9653-b6e128589efc {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:03:26.668378 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Port 450b43c8-80f4-420a-a8ae-14a79c1f2644 on network a8a02a2d-c194-4f2f-9653-b6e128589efc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:03:26.668699 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Attempting to bind port 450b43c8-80f4-420a-a8ae-14a79c1f2644 on network a8a02a2d-c194-4f2f-9653-b6e128589efc {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:03:26.673519 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 3, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:03:26.673888 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Checking segment: {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:03:26.674258 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Bound using segment: {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:03:26.674679 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Bound port: 450b43c8-80f4-420a-a8ae-14a79c1f2644, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:03:26.675088 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:26.743579 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] For port 450b43c8-80f4-420a-a8ae-14a79c1f2644, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:03:26.746630 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] For port 450b43c8-80f4-420a-a8ae-14a79c1f2644, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=450b43c8-80f4-420a-a8ae-14a79c1f2644,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:03:26.754138 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9410fec3-944d-41a7-b58a-ea7950653e16 tempest-TestVolumeBootPattern-1918149566 tempest-TestVolumeBootPattern-1918149566-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:26.755650 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-9410fec3-944d-41a7-b58a-ea7950653e16 tempest-TestVolumeBootPattern-1918149566 tempest-TestVolumeBootPattern-1918149566-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 1093 time: 0.1756759 Aug 24 03:03:26.758542 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 36998) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:26.762825 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'floatingip': {'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'port_id': '894657b8-22e4-4340-af94-46bb6d84e3d7', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address': '172.20.0.4'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:26.825876 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:26.869239 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:26.869239 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:26.869239 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] 10.222.0.43 "PUT /v2.0/ports/450b43c8-80f4-420a-a8ae-14a79c1f2644 HTTP/1.1" status: 200 len: 1093 time: 0.8405511 Aug 24 03:03:26.869239 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c1b52e4a-a25e-48b6-a970-280f7ae198b7', 'tag': '450b43c8-80f4-420a-a8ae-14a79c1f2644'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:03:26.869239 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-558cd0b3-33d3-4a4a-94f3-25f7cb4af6c3" -d '{"events": [{"name": "network-changed", "server_uuid": "c1b52e4a-a25e-48b6-a970-280f7ae198b7", "tag": "450b43c8-80f4-420a-a8ae-14a79c1f2644"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:03:26.888195 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:26.888470 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ed2240a-ec44-40d2-9511-ed14e8cfc328 service neutron] Pushing event updated for resources: {'Port': ['ID=450b43c8-80f4-420a-a8ae-14a79c1f2644,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:26.909522 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:03:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-72e2b526-8708-4f7f-b51d-029db7806c5a x-openstack-request-id: req-72e2b526-8708-4f7f-b51d-029db7806c5a {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:03:26.909843 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c1b52e4a-a25e-48b6-a970-280f7ae198b7", "tag": "450b43c8-80f4-420a-a8ae-14a79c1f2644", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:03:26.910150 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-72e2b526-8708-4f7f-b51d-029db7806c5a {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:03:26.910718 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c1b52e4a-a25e-48b6-a970-280f7ae198b7', 'tag': '450b43c8-80f4-420a-a8ae-14a79c1f2644', 'status': 'completed', 'code': 200} Aug 24 03:03:26.972712 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-558cd0b3-33d3-4a4a-94f3-25f7cb4af6c3 req-042c5144-53de-451a-b9ef-6c71fb434fd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:26.974390 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-558cd0b3-33d3-4a4a-94f3-25f7cb4af6c3 req-042c5144-53de-451a-b9ef-6c71fb434fd0 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 1096 time: 0.0433452 Aug 24 03:03:26.981672 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:26.987250 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:27.106810 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Allocated IP 172.27.2.38 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/b8e7b6dd-ec71-400b-9130-93076be161d3) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:03:27.115180 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-558cd0b3-33d3-4a4a-94f3-25f7cb4af6c3 req-2c0a77c1-d4b8-452b-b764-ffc38792dffc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:27.116750 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-558cd0b3-33d3-4a4a-94f3-25f7cb4af6c3 req-2c0a77c1-d4b8-452b-b764-ffc38792dffc service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1337543 Aug 24 03:03:27.142338 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7881f7f-2659-4098-88f4-9584cbb9fe32 req-c632f85c-ae33-41cf-b452-c336e304a2ed tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:27.143825 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f7881f7f-2659-4098-88f4-9584cbb9fe32 req-c632f85c-ae33-41cf-b452-c336e304a2ed tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0621760 Aug 24 03:03:27.204261 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10235aab-0209-42d9-8493-03d29b485748 req-5e485787-b873-49c3-baf8-40bc5b914a47 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:27.205765 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-10235aab-0209-42d9-8493-03d29b485748 req-5e485787-b873-49c3-baf8-40bc5b914a47 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 943 time: 0.1011610 Aug 24 03:03:27.234503 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f7881f7f-2659-4098-88f4-9584cbb9fe32 req-7e0ce3e4-b608-4339-a8a5-e955465e5ef9 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0823848 Aug 24 03:03:27.261870 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:27.267980 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-558cd0b3-33d3-4a4a-94f3-25f7cb4af6c3 req-6dceba75-7720-4a06-bfa2-39bc7179b466 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:27.269945 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-558cd0b3-33d3-4a4a-94f3-25f7cb4af6c3 req-6dceba75-7720-4a06-bfa2-39bc7179b466 service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1357310 Aug 24 03:03:27.293710 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-10235aab-0209-42d9-8493-03d29b485748 req-fcf4a02c-d3e7-445a-98d5-edf40647483b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809655 Aug 24 03:03:27.343588 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-82c930c9-dd61-404c-a38a-c6f3a3b157ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:27.345064 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-82c930c9-dd61-404c-a38a-c6f3a3b157ea service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 1096 time: 0.0409060 Aug 24 03:03:27.376302 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:27.385321 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-7fb5a81c-7370-4aaa-867d-5f7c20d8131a service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=450b43c8-80f4-420a-a8ae-14a79c1f2644 HTTP/1.1" status: 200 len: 217 time: 0.0327950 Aug 24 03:03:27.411353 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:03:27.414136 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:27.417370 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:03:27.438356 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-cc68b603-0e61-4387-9f41-decd736b58f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:27.439998 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-cc68b603-0e61-4387-9f41-decd736b58f6 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=05cef140-037d-459e-a03d-a6915273f9d4 HTTP/1.1" status: 200 len: 855 time: 0.0480866 Aug 24 03:03:27.446209 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'Port': ['ID=b8e7b6dd-ec71-400b-9130-93076be161d3,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:27.479554 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-85bec34e-de1f-48d8-964e-4f1619b1808d service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=a8a02a2d-c194-4f2f-9653-b6e128589efc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0271406 Aug 24 03:03:27.583906 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a054b68c-8510-4d1f-9882-e74e595c761f req-36eed8bd-e7f8-4b5b-b660-29aa90b1b564 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:27.585465 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a054b68c-8510-4d1f-9882-e74e595c761f req-36eed8bd-e7f8-4b5b-b660-29aa90b1b564 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.1084049 Aug 24 03:03:27.619569 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-31f99e80-eaee-4943-a3ea-39657b61b63e service neutron] 10.222.0.43 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1308146 Aug 24 03:03:27.659183 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a054b68c-8510-4d1f-9882-e74e595c761f req-e2470218-775d-473e-9f8c-9afb407483a0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0632374 Aug 24 03:03:27.736437 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb3dd638-39e8-4156-b08a-8a5911e3d33c req-035fdef2-493e-4b30-bb90-ee07477b2534 service neutron] 10.222.0.43 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1095757 Aug 24 03:03:28.019628 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:28.160296 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:28.319285 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for port, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:28.359118 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87d9d2b0-61dc-4d0b-bb8e-fe7a7ab126cc req-20e97b65-d9f0-415d-b136-51c50070c3ae tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:28.360644 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-87d9d2b0-61dc-4d0b-bb8e-fe7a7ab126cc req-20e97b65-d9f0-415d-b136-51c50070c3ae tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0531139 Aug 24 03:03:28.399577 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-87d9d2b0-61dc-4d0b-bb8e-fe7a7ab126cc req-f13da653-0928-4984-b0b0-bbea1360d442 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0316744 Aug 24 03:03:28.406976 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3484283'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:28.409198 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ac9df6d-59fa-494a-9937-603f8da8bb8e req-6e170f0e-5677-480d-a926-9742da08d8b0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:28.411563 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5ac9df6d-59fa-494a-9937-603f8da8bb8e req-6e170f0e-5677-480d-a926-9742da08d8b0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 943 time: 0.0500174 Aug 24 03:03:28.465302 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5ac9df6d-59fa-494a-9937-603f8da8bb8e req-f2efe404-63e2-42c6-aa3b-48e4b998b1da tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393412 Aug 24 03:03:28.480734 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'Port': ['ID=b8e7b6dd-ec71-400b-9130-93076be161d3,revision_number=2']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:28.491227 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:28.587052 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.l3_db [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Floating IP 8bd3ec8e-9712-4a9c-96d2-64724391335a associated. External IP: 172.27.2.38, port: 894657b8-22e4-4340-af94-46bb6d84e3d7. Aug 24 03:03:28.820966 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d79ef67a-7967-4818-b88c-026ee37562b1 req-32afe564-8e0f-4e2b-95f0-d11721ce5936 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:28.823257 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d79ef67a-7967-4818-b88c-026ee37562b1 req-32afe564-8e0f-4e2b-95f0-d11721ce5936 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0908303 Aug 24 03:03:28.825378 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:03:28.897606 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d79ef67a-7967-4818-b88c-026ee37562b1 req-3fb67fb0-8e4f-4494-bd99-b1fa1f319c3c tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0682385 Aug 24 03:03:28.958991 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:03:28.968268 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd1602d1-334e-44f2-815b-334cf41bb9e7 None None] Sync routers for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:03:28.976930 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd1602d1-334e-44f2-815b-334cf41bb9e7 None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:03:28.977540 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-fd1602d1-334e-44f2-815b-334cf41bb9e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:03:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:29.028123 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:29.059515 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-324e4b4e-e80b-4a52-b25f-bfa3bc651e8d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.2999532 Aug 24 03:03:29.060362 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'tag': '894657b8-22e4-4340-af94-46bb6d84e3d7'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:03:29.062711 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-26703372-c23c-4494-a738-609f7868a15b" -d '{"events": [{"name": "network-changed", "server_uuid": "07edef45-7d42-46a0-89b8-2a6e24a64a16", "tag": "894657b8-22e4-4340-af94-46bb6d84e3d7"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:03:29.086070 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-fd1602d1-334e-44f2-815b-334cf41bb9e7 None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:03:29.101252 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:03:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5209efe-7861-47dd-9c71-87768d05749b x-openstack-request-id: req-c5209efe-7861-47dd-9c71-87768d05749b {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:03:29.101540 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "07edef45-7d42-46a0-89b8-2a6e24a64a16", "tag": "894657b8-22e4-4340-af94-46bb6d84e3d7", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:03:29.101840 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c5209efe-7861-47dd-9c71-87768d05749b {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:03:29.102293 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'tag': '894657b8-22e4-4340-af94-46bb6d84e3d7', 'status': 'completed', 'code': 200} Aug 24 03:03:29.161978 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26703372-c23c-4494-a738-609f7868a15b req-79ccccde-2159-411f-a8fc-f4619ac06f18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:29.163432 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26703372-c23c-4494-a738-609f7868a15b req-79ccccde-2159-411f-a8fc-f4619ac06f18 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 1098 time: 0.0411828 Aug 24 03:03:29.259655 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26703372-c23c-4494-a738-609f7868a15b req-591fe584-e545-4811-8caf-52f61fe57e1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:29.262069 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26703372-c23c-4494-a738-609f7868a15b req-591fe584-e545-4811-8caf-52f61fe57e1d service neutron] 10.222.0.43 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 913 time: 0.0914834 Aug 24 03:03:29.333703 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26703372-c23c-4494-a738-609f7868a15b req-e9157b69-63d8-4354-98ce-65886b870754 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=894657b8-22e4-4340-af94-46bb6d84e3d7 HTTP/1.1" status: 200 len: 998 time: 0.0649419 Aug 24 03:03:29.366784 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-fd1602d1-334e-44f2-815b-334cf41bb9e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': '8bd3ec8e-9712-4a9c-96d2-64724391335a', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.38', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': '894657b8-22e4-4340-af94-46bb6d84e3d7', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 419, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:e7:7a:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:03:27Z', 'updated_at': '2021-08-24T03:03:27Z', 'revision_number': 0, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:29.383685 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26703372-c23c-4494-a738-609f7868a15b req-acac25ab-540c-4163-a52d-552c4fcf99ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:29.385136 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26703372-c23c-4494-a738-609f7868a15b req-acac25ab-540c-4163-a52d-552c4fcf99ff service neutron] 10.222.0.43 "GET /v2.0/subnets?id=9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 200 len: 851 time: 0.0442064 Aug 24 03:03:29.395656 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd1602d1-334e-44f2-815b-334cf41bb9e7 None None] Checking router: 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:03:29.404080 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd1602d1-334e-44f2-815b-334cf41bb9e7 None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:03:29.404686 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-fd1602d1-334e-44f2-815b-334cf41bb9e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:03:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:29.431975 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26703372-c23c-4494-a738-609f7868a15b req-7b9872f7-fa12-4d4e-95e0-16ef40c2695e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:29.433382 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26703372-c23c-4494-a738-609f7868a15b req-7b9872f7-fa12-4d4e-95e0-16ef40c2695e service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0402517 Aug 24 03:03:29.519887 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-fd1602d1-334e-44f2-815b-334cf41bb9e7 None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:03:29.532645 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea0f03e4-4c0b-4c6b-b200-375509663c51 req-9e8aa46e-0397-4604-a2f7-dedf7a3dec73 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:29.541079 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ea0f03e4-4c0b-4c6b-b200-375509663c51 req-9e8aa46e-0397-4604-a2f7-dedf7a3dec73 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0647671 Aug 24 03:03:29.547453 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26703372-c23c-4494-a738-609f7868a15b req-e7d28a34-4ae1-4c1f-8cdf-385a49d5f330 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1046910 Aug 24 03:03:29.577799 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ea0f03e4-4c0b-4c6b-b200-375509663c51 req-4df333f7-30b5-4009-8ceb-537c3883802a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0357482 Aug 24 03:03:29.648632 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d473d7-345e-455e-8193-a25cb7639677 req-94d5d4cc-de0b-43f2-a3e6-1ad3a7b0a448 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:29.650285 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-13d473d7-345e-455e-8193-a25cb7639677 req-94d5d4cc-de0b-43f2-a3e6-1ad3a7b0a448 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 943 time: 0.1017992 Aug 24 03:03:29.703120 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26703372-c23c-4494-a738-609f7868a15b req-cf0f70d5-e0e5-461c-8f8e-b4caabe6aa4e service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1442826 Aug 24 03:03:29.708797 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-13d473d7-345e-455e-8193-a25cb7639677 req-ae90bbcb-ad9b-4502-a117-024b13a16268 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516038 Aug 24 03:03:29.875737 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-fd1602d1-334e-44f2-815b-334cf41bb9e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': '8bd3ec8e-9712-4a9c-96d2-64724391335a', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.38', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': '894657b8-22e4-4340-af94-46bb6d84e3d7', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 419, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:e7:7a:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:03:27Z', 'updated_at': '2021-08-24T03:03:27Z', 'revision_number': 0, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:29.901062 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd1602d1-334e-44f2-815b-334cf41bb9e7 None None] The sync data for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi is: [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': '8bd3ec8e-9712-4a9c-96d2-64724391335a', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.38', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': '894657b8-22e4-4340-af94-46bb6d84e3d7', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 419, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:e7:7a:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:03:27Z', 'updated_at': '2021-08-24T03:03:27Z', 'revision_number': 0, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:03:30.014094 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4602829e-9847-4564-902f-91362edc011c req-048f5e04-1e42-415d-9559-9a67f5f18c1e tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:30.015616 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4602829e-9847-4564-902f-91362edc011c req-048f5e04-1e42-415d-9559-9a67f5f18c1e tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0487382 Aug 24 03:03:30.059109 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4602829e-9847-4564-902f-91362edc011c req-2ac4f6fb-4050-4c28-ad53-a709abc25617 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0367339 Aug 24 03:03:30.092202 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8442a3c-951e-455f-9e21-660d282c8a3b None None] New status for floating IP 8bd3ec8e-9712-4a9c-96d2-64724391335a: ACTIVE {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:03:30.336487 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37052) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:30.379919 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-d4230bfb-5025-4caa-bc6f-32afdd6a29ed admin admin] Deleting subnet fbe73e0e-d251-4e49-99f9-e952356c2e56 {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:03:30.384390 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d4230bfb-5025-4caa-bc6f-32afdd6a29ed admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:30.416887 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d4230bfb-5025-4caa-bc6f-32afdd6a29ed admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:30.456435 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d4230bfb-5025-4caa-bc6f-32afdd6a29ed admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:30.602083 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d4230bfb-5025-4caa-bc6f-32afdd6a29ed admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:30.631495 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4230bfb-5025-4caa-bc6f-32afdd6a29ed admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fbe73e0e-d251-4e49-99f9-e952356c2e56,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:30.635802 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d4230bfb-5025-4caa-bc6f-32afdd6a29ed admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:30.641423 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-d4230bfb-5025-4caa-bc6f-32afdd6a29ed admin admin] 10.222.0.30 "DELETE /v2.0/subnets/fbe73e0e-d251-4e49-99f9-e952356c2e56 HTTP/1.1" status: 204 len: 168 time: 0.3003392 Aug 24 03:03:30.641423 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37056) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:30.701484 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b7e59c3-4496-4bc6-ac0e-4f11af510f52 req-60ad6660-b54d-4876-bbae-957a563ae8ac tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:30.703013 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b7e59c3-4496-4bc6-ac0e-4f11af510f52 req-60ad6660-b54d-4876-bbae-957a563ae8ac tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 944 time: 0.0486772 Aug 24 03:03:30.709218 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:30.742320 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4b7e59c3-4496-4bc6-ac0e-4f11af510f52 req-8a6a8bcb-b40d-443d-a93a-6d774241f3f9 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0317070 Aug 24 03:03:30.809784 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:30.822710 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee']}} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:30.835547 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8153f8c3-eca4-496c-bd4f-59ba0022c639') {'for_net_delete': True} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:30.835843 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8153f8c3-eca4-496c-bd4f-59ba0022c639') {} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:30.847082 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25719248'] for segment, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:30.862784 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2660e4fe-a79d-4d9b-bfc2-711ffd38ea91 req-3a414b45-ebd2-4ab5-9842-47d86c05079d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:30.864260 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2660e4fe-a79d-4d9b-bfc2-711ffd38ea91 req-3a414b45-ebd2-4ab5-9842-47d86c05079d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 943 time: 0.0812101 Aug 24 03:03:30.870018 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:30.882079 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] Releasing vlan 361 on physical network physnet1 to pool {{(pid=111275) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:03:30.882459 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3484247'] for segment, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: Traceback (most recent call last): Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: timer() Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: cb(*args, **kw) Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: return func(*args, **kwargs) Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: self._notify() Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: self.callback(batched_events) Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: event.method(event) Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: return f(self, *a, **k) Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._get(url).json() Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: return self.request(url, 'GET', **kwargs) Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:03:30.883993 dv-cinder-803748-8-iscsi neutron-server[111275]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:03:30.953304 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2660e4fe-a79d-4d9b-bfc2-711ffd38ea91 req-9e066bc3-6983-4011-8535-5a987cd6fe8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811481 Aug 24 03:03:31.033218 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:31.046207 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:31.046207 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] 10.222.0.30 "DELETE /v2.0/networks/f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee HTTP/1.1" status: 204 len: 168 time: 0.4001319 Aug 24 03:03:31.050489 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1010f63c-2e2d-4889-bf52-562cd400d18f admin admin] Pushing event deleted for resources: {'Network': ['ID=f6df7c9f-14d6-4946-9b52-cfe9c7fa6eee,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:31.148043 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 881a8667-42c4-4263-84c5-a172725c834f details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:03:31.172432 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c465f8b1-a229-4077-8337-0718e94108d0 req-00642c1f-f9c8-431d-9c10-2b4a8b4cd2f6 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:31.173904 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c465f8b1-a229-4077-8337-0718e94108d0 req-00642c1f-f9c8-431d-9c10-2b4a8b4cd2f6 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0485163 Aug 24 03:03:31.213050 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c465f8b1-a229-4077-8337-0718e94108d0 req-3a1992a1-21f7-4c5e-acf9-79c747c12e18 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0321863 Aug 24 03:03:31.245610 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=881a8667-42c4-4263-84c5-a172725c834f,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:31.257066 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '881a8667-42c4-4263-84c5-a172725c834f', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'port_id': '881a8667-42c4-4263-84c5-a172725c834f', 'mac_address': 'fa:16:3e:85:26:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:03:31.299992 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:31.313346 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 881a8667-42c4-4263-84c5-a172725c834f {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:03:31.331806 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=881a8667-42c4-4263-84c5-a172725c834f,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:31.379109 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37064) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:31.417603 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-5c7701b3-2eaa-431a-a798-803966c352f2 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=3b289da7de434e9ca4c67edc2769c6ab&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0373175 Aug 24 03:03:31.419935 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37066) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:31.421784 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:31.422526 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 450b43c8-80f4-420a-a8ae-14a79c1f2644 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:03:31.467091 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8e2e3cc-f1d3-4ab1-9530-94fba0f64cfc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:31.488257 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8e2e3cc-f1d3-4ab1-9530-94fba0f64cfc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:31.513350 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=881a8667-42c4-4263-84c5-a172725c834f,revision_number=9']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:31.556914 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 450b43c8-80f4-420a-a8ae-14a79c1f2644, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=450b43c8-80f4-420a-a8ae-14a79c1f2644,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:31.567621 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '450b43c8-80f4-420a-a8ae-14a79c1f2644', 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc', 'port_id': '450b43c8-80f4-420a-a8ae-14a79c1f2644', 'mac_address': 'fa:16:3e:d0:ce:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 382, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '05cef140-037d-459e-a03d-a6915273f9d4', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:03:31.604500 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:31.610355 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8e2e3cc-f1d3-4ab1-9530-94fba0f64cfc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:31.613096 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8e2e3cc-f1d3-4ab1-9530-94fba0f64cfc admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:31.617116 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a8e2e3cc-f1d3-4ab1-9530-94fba0f64cfc admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/a4b4030d-36ff-4ec4-a865-deeb8b403f2e HTTP/1.1" status: 204 len: 168 time: 0.1939673 Aug 24 03:03:31.621242 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 450b43c8-80f4-420a-a8ae-14a79c1f2644 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:03:31.623393 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e2e3cc-f1d3-4ab1-9530-94fba0f64cfc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4b4030d-36ff-4ec4-a865-deeb8b403f2e,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:31.648204 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 450b43c8-80f4-420a-a8ae-14a79c1f2644, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=450b43c8-80f4-420a-a8ae-14a79c1f2644,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:31.739688 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:31.790585 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=450b43c8-80f4-420a-a8ae-14a79c1f2644,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:31.864390 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-887b48f5-fda5-472b-aced-fd77a9a5b036 req-0fe9af0a-794b-42ab-8cea-59d4b2b790b3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:31.865863 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-887b48f5-fda5-472b-aced-fd77a9a5b036 req-0fe9af0a-794b-42ab-8cea-59d4b2b790b3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 945 time: 0.0492754 Aug 24 03:03:31.906377 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-887b48f5-fda5-472b-aced-fd77a9a5b036 req-fcb7bcfe-e7d9-490f-87aa-9743ac43df89 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0344546 Aug 24 03:03:31.982781 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['450b43c8-80f4-420a-a8ae-14a79c1f2644'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:03:31.988412 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['881a8667-42c4-4263-84c5-a172725c834f'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:03:32.074037 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ea3e7c-fec8-4a40-b53a-a169887f6dd8 req-48bbe319-7272-4015-8b9b-5603cd75d426 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:32.075590 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d6ea3e7c-fec8-4a40-b53a-a169887f6dd8 req-48bbe319-7272-4015-8b9b-5603cd75d426 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 944 time: 0.0564508 Aug 24 03:03:32.120612 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d6ea3e7c-fec8-4a40-b53a-a169887f6dd8 req-a82f068e-2a1e-4628-bdff-0e8cda766447 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0370891 Aug 24 03:03:32.326660 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b185d626-d8d0-4a5b-82fa-c84ae272fa38 req-9b92e23f-ac9f-4d26-978d-824dd38feecb tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:32.328121 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b185d626-d8d0-4a5b-82fa-c84ae272fa38 req-9b92e23f-ac9f-4d26-978d-824dd38feecb tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0484300 Aug 24 03:03:32.364878 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b185d626-d8d0-4a5b-82fa-c84ae272fa38 req-6dc62038-175a-46cb-abd5-76ea349f9efa tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0298843 Aug 24 03:03:32.667952 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37094) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:32.761593 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1334498724-network', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:32.890383 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Made reservation on behalf of 8bca2ab0549a4f099c2421571c26f61b for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:03:32.893174 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:32.902422 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:32.990225 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.028685 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdf9c061-9ef5-4232-8200-3a944c230845 req-716c8f41-157e-42ce-af48-84d301142fca tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:33.030309 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fdf9c061-9ef5-4232-8200-3a944c230845 req-716c8f41-157e-42ce-af48-84d301142fca tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 945 time: 0.0492799 Aug 24 03:03:33.061454 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.068131 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fdf9c061-9ef5-4232-8200-3a944c230845 req-971173ae-5b06-45e7-ab2c-ff5f99356fd7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0316451 Aug 24 03:03:33.086739 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] vlan segment allocate from pool success with {'vlan_id': 375, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:03:33.096066 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=904c6741-697e-451f-9490-97353282f9d2,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:33.100675 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.105203 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Added segment 63d10721-d1ef-4dcf-aa60-b159fdfbd4fb of type vlan for network 866d4604-551e-4da3-b89c-967338dbafff Aug 24 03:03:33.138720 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.153987 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 450b43c8-80f4-420a-a8ae-14a79c1f2644 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:33.246801 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9895e88c-318a-44f9-a9a7-b9d3fa61822b req-e62f803f-55f2-4872-b5fb-f221c61364cf tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:33.248281 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9895e88c-318a-44f9-a9a7-b9d3fa61822b req-e62f803f-55f2-4872-b5fb-f221c61364cf tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 944 time: 0.0569055 Aug 24 03:03:33.281530 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.282451 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:33.283013 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.297119 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9895e88c-318a-44f9-a9a7-b9d3fa61822b req-28ec0486-feb0-4cbf-bff4-691bd4aff730 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422006 Aug 24 03:03:33.307042 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 450b43c8-80f4-420a-a8ae-14a79c1f2644 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:33.317865 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 450b43c8-80f4-420a-a8ae-14a79c1f2644 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:33.317865 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.347944 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] Pushing event updated for resources: {'Network': ['ID=866d4604-551e-4da3-b89c-967338dbafff,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:33.358438 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 866d4604-551e-4da3-b89c-967338dbafff details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:03:33.394296 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-3bbb7977-d320-464d-8e00-7fa8010165a9 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.7226458 Aug 24 03:03:33.394855 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37104) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:33.401435 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-d8dfd7d2-2a85-4ff4-a934-43cb0a10d7b0 admin admin] Request body: {'subnet': {'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1334498724-subnet', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'ip_version': 4}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:33.434479 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.469738 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c1b52e4a-a25e-48b6-a970-280f7ae198b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '450b43c8-80f4-420a-a8ae-14a79c1f2644'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:03:33.471969 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6fd801d4-705a-4c1f-aa28-e4ad49d52e24" -d '{"events": [{"server_uuid": "c1b52e4a-a25e-48b6-a970-280f7ae198b7", "name": "network-vif-plugged", "status": "completed", "tag": "450b43c8-80f4-420a-a8ae-14a79c1f2644"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:03:33.484033 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beb29e92-9e3a-4db7-94d2-0602ff7279cf req-977421de-7295-471e-b956-1359f8d22e79 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:33.485094 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 450b43c8-80f4-420a-a8ae-14a79c1f2644, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=450b43c8-80f4-420a-a8ae-14a79c1f2644,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:33.485543 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-beb29e92-9e3a-4db7-94d2-0602ff7279cf req-977421de-7295-471e-b956-1359f8d22e79 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0509017 Aug 24 03:03:33.499738 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8dfd7d2-2a85-4ff4-a934-43cb0a10d7b0 admin admin] Made reservation on behalf of 8bca2ab0549a4f099c2421571c26f61b for: {'subnet': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:03:33.502010 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d8dfd7d2-2a85-4ff4-a934-43cb0a10d7b0 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25854793'] for subnet, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.510212 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:03:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6df23210-0933-42c6-82b7-4c6d0313a8fa x-openstack-request-id: req-6df23210-0933-42c6-82b7-4c6d0313a8fa {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:03:33.510506 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c1b52e4a-a25e-48b6-a970-280f7ae198b7", "name": "network-vif-plugged", "status": "completed", "tag": "450b43c8-80f4-420a-a8ae-14a79c1f2644", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:03:33.510780 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-6df23210-0933-42c6-82b7-4c6d0313a8fa {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:03:33.511201 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c1b52e4a-a25e-48b6-a970-280f7ae198b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '450b43c8-80f4-420a-a8ae-14a79c1f2644', 'code': 200} Aug 24 03:03:33.584749 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.585553 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 881a8667-42c4-4263-84c5-a172725c834f up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:33.585976 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-beb29e92-9e3a-4db7-94d2-0602ff7279cf req-285d37fc-15d0-41e3-a692-50f1dd298b01 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0929744 Aug 24 03:03:33.663818 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=450b43c8-80f4-420a-a8ae-14a79c1f2644,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:33.680025 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 881a8667-42c4-4263-84c5-a172725c834f triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:33.685851 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.755683 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.789078 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=881a8667-42c4-4263-84c5-a172725c834f,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:33.791111 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d8dfd7d2-2a85-4ff4-a934-43cb0a10d7b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3523558', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25854779'] for subnet, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.864238 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8dfd7d2-2a85-4ff4-a934-43cb0a10d7b0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4ffb6451-69cb-476e-bc2e-5b6165a067b1,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:33.880373 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4406a8fc-5ae4-43ed-bd9a-d91ee67fc112 req-36106ee0-3795-4acc-825f-ad845b690d67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:33.881885 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4406a8fc-5ae4-43ed-bd9a-d91ee67fc112 req-36106ee0-3795-4acc-825f-ad845b690d67 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 1098 time: 0.0884962 Aug 24 03:03:33.889824 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8dfd7d2-2a85-4ff4-a934-43cb0a10d7b0 admin admin] Checking segment: {'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:03:33.890181 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8dfd7d2-2a85-4ff4-a934-43cb0a10d7b0 admin admin] Network hostable DHCP agents. Network: 866d4604-551e-4da3-b89c-967338dbafff, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111276) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:03:33.899422 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:33.928179 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4406a8fc-5ae4-43ed-bd9a-d91ee67fc112 req-ea8cf874-7bfd-49a4-b399-9ba9c7ab540a service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394123 Aug 24 03:03:33.951719 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=881a8667-42c4-4263-84c5-a172725c834f,revision_number=10']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:34.009883 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8dfd7d2-2a85-4ff4-a934-43cb0a10d7b0 admin admin] Network 866d4604-551e-4da3-b89c-967338dbafff is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111276) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:03:34.123227 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-d8dfd7d2-2a85-4ff4-a934-43cb0a10d7b0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 866d4604-551e-4da3-b89c-967338dbafff) {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:34.129850 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8dfd7d2-2a85-4ff4-a934-43cb0a10d7b0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:34.130135 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d8dfd7d2-2a85-4ff4-a934-43cb0a10d7b0 admin admin] Notify callbacks [] for subnet, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:34.135366 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db0901a6-c5fa-45f9-b403-76167bfc8a32 None None] Network 866d4604-551e-4da3-b89c-967338dbafff requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:03:34.284148 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc8ebca0a-8efd-5c96-8278-1a4ec08c6f82-866d4604-551e-4da3-b89c-967338dbafff', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'fixed_ips': [{'subnet_id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1'}]}} from dv-cinder-803748-8-iscsi. {{(pid=111277) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Aug 24 03:03:34.285791 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:34.360993 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-d8dfd7d2-2a85-4ff4-a934-43cb0a10d7b0 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.9648199 Aug 24 03:03:34.364726 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37112) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:34.372524 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:34.405292 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-310227a9-8c6c-4963-85d6-4ef7758e9bd9 req-4031cbc3-bbf3-4831-8dfe-cdac40e2449d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:34.406800 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-310227a9-8c6c-4963-85d6-4ef7758e9bd9 req-4031cbc3-bbf3-4831-8dfe-cdac40e2449d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 947 time: 0.2621427 Aug 24 03:03:34.427793 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.db_base_plugin_common [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Allocated IP 172.20.0.2 (866d4604-551e-4da3-b89c-967338dbafff/4ffb6451-69cb-476e-bc2e-5b6165a067b1/c3dce199-252c-46ff-8b13-b023698467be) {{(pid=111277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:03:34.447803 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c92556f-e05f-49d3-aed2-5f8e91ddf48e req-2f944b25-ad42-4d0a-a60b-4b0db408c18a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:34.449385 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9c92556f-e05f-49d3-aed2-5f8e91ddf48e req-2f944b25-ad42-4d0a-a60b-4b0db408c18a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 945 time: 0.0696995 Aug 24 03:03:34.452330 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-310227a9-8c6c-4963-85d6-4ef7758e9bd9 req-306b42ac-8fa9-427d-b16f-274d20ee87cd tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0379636 Aug 24 03:03:34.490582 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9c92556f-e05f-49d3-aed2-5f8e91ddf48e req-2b6627b0-7173-4469-a483-efbe03eadd4b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340304 Aug 24 03:03:34.541778 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-560365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32717'] for router, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:34.542755 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-560249', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-569518', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-437890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32692'] for router, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:34.578067 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Notify callbacks [] for port, precommit_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:34.586245 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Transition to ACTIVE for port object c3dce199-252c-46ff-8b13-b023698467be will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:03:34.592715 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:34.600800 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Transition to ACTIVE for port object c3dce199-252c-46ff-8b13-b023698467be will not be triggered until provisioned by entity DHCP. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:03:34.668146 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:34.702546 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-854fb8df-a6c1-470a-83cb-09f4311cef39 req-5b577f57-9b9a-4910-b47d-9f0494611553 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:34.704220 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-854fb8df-a6c1-470a-83cb-09f4311cef39 req-5b577f57-9b9a-4910-b47d-9f0494611553 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0518155 Aug 24 03:03:34.715546 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Network 866d4604-551e-4da3-b89c-967338dbafff is already hosted by enough agents. {{(pid=111277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:03:34.723596 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.base_scheduler [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Resources bound (agent type, host, resource id): {{(pid=111277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:34.725436 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Pushing event updated for resources: {'Port': ['ID=c3dce199-252c-46ff-8b13-b023698467be,revision_number=1']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:34.732694 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Received port after_create {{(pid=111277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:03:34.744202 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-854fb8df-a6c1-470a-83cb-09f4311cef39 req-957e6f9f-c0e0-48d3-9e89-b0da3242b03a tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0331640 Aug 24 03:03:34.782017 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:34.785724 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Attempting to bind port c3dce199-252c-46ff-8b13-b023698467be on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:03:34.785996 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Attempting to bind port c3dce199-252c-46ff-8b13-b023698467be by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:03:34.786356 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Attempting to bind port c3dce199-252c-46ff-8b13-b023698467be on network 866d4604-551e-4da3-b89c-967338dbafff {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:03:34.791269 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:03:34.791690 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Checking segment: {'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:03:34.792139 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:34.792476 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Bound using segment: {'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:03:34.792932 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Bound port: c3dce199-252c-46ff-8b13-b023698467be, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:03:34.793336 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:34.859926 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] For port c3dce199-252c-46ff-8b13-b023698467be, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:03:34.863987 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] For port c3dce199-252c-46ff-8b13-b023698467be, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=c3dce199-252c-46ff-8b13-b023698467be,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:03:34.947811 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:35.009993 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f9a1fc9-8baf-44d7-9d19-a1471e7e1658 None None] Pushing event updated for resources: {'Port': ['ID=c3dce199-252c-46ff-8b13-b023698467be,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:35.040302 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:35.063452 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:35.191033 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Allocated IP 172.27.2.173 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/2a166f3b-bb0b-4491-b944-aa2b23edd1b6) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:03:35.307129 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:35.402631 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:35.443075 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:03:35.445897 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:35.448274 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:03:35.475640 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Pushing event updated for resources: {'Port': ['ID=2a166f3b-bb0b-4491-b944-aa2b23edd1b6,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:35.512025 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '881a8667-42c4-4263-84c5-a172725c834f'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:03:35.514906 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a6064bee-736b-45a6-9e8f-06ddb02b24a3" -d '{"events": [{"server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "name": "network-vif-plugged", "status": "completed", "tag": "881a8667-42c4-4263-84c5-a172725c834f"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:03:35.617210 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ccaa1d-07db-49c1-b92a-41e335d380dc req-5ff2fb8d-5128-4a96-b056-8045d1b231e4 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:35.618998 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-96ccaa1d-07db-49c1-b92a-41e335d380dc req-5ff2fb8d-5128-4a96-b056-8045d1b231e4 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 945 time: 0.0527966 Aug 24 03:03:35.671750 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-96ccaa1d-07db-49c1-b92a-41e335d380dc req-3459dd39-761f-4e45-95f8-c47b6051ff73 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442955 Aug 24 03:03:35.727733 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:03:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb1aca72-c544-453c-9fca-cf085531cf1e x-openstack-request-id: req-cb1aca72-c544-453c-9fca-cf085531cf1e {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:03:35.728654 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "name": "network-vif-plugged", "status": "completed", "tag": "881a8667-42c4-4263-84c5-a172725c834f", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:03:35.728654 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cb1aca72-c544-453c-9fca-cf085531cf1e {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:03:35.728654 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '881a8667-42c4-4263-84c5-a172725c834f', 'code': 200} Aug 24 03:03:35.899358 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8193bcbc-c114-41df-bf14-faeaf342aa08 req-71653826-7117-473f-826e-3d8752e72b11 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:35.901229 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8193bcbc-c114-41df-bf14-faeaf342aa08 req-71653826-7117-473f-826e-3d8752e72b11 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0564466 Aug 24 03:03:35.913129 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aa2dcce-1a91-40ff-949d-911220cbf658 req-920d02be-ed79-4566-ace5-4274f93aa0ff tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:35.914973 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9aa2dcce-1a91-40ff-949d-911220cbf658 req-920d02be-ed79-4566-ace5-4274f93aa0ff tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 947 time: 0.0905676 Aug 24 03:03:35.953872 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8193bcbc-c114-41df-bf14-faeaf342aa08 req-cdc69db8-12e9-42c9-a07a-209be9284c0d tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456245 Aug 24 03:03:35.957896 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9aa2dcce-1a91-40ff-949d-911220cbf658 req-3108bfaa-eb74-47d4-8b81-b77b4314f118 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0359011 Aug 24 03:03:35.990764 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4eb5080f-ff59-40c7-9c15-c4a4182916e0 None None] Network 866d4604-551e-4da3-b89c-967338dbafff requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:03:36.412309 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:36.414580 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-fa2106e0-fe7d-4487-8661-c19dbce58a00 None None] Provisioning for port c3dce199-252c-46ff-8b13-b023698467be completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:36.415427 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-560242', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-569595'] for router, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:36.547783 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d14a1e3-a49e-4fb2-b461-1abb4df4eea2 req-442dae0b-52c0-4c9c-a2bf-e97054414e09 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:36.549260 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5d14a1e3-a49e-4fb2-b461-1abb4df4eea2 req-442dae0b-52c0-4c9c-a2bf-e97054414e09 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0553787 Aug 24 03:03:36.618086 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5d14a1e3-a49e-4fb2-b461-1abb4df4eea2 req-d6eff3e4-cba0-46bb-8627-03cac0f30af0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0619307 Aug 24 03:03:36.649352 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Router 237f95eb-7035-4674-99ff-35e2f14fc035 is scheduled to L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 with binding_index 1 {{(pid=111276) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Aug 24 03:03:36.653806 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1c77abe-9f46-434c-b98c-5dc3f11cc8e8 req-93e4298d-98aa-46ef-b061-bb6c4540bb79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:36.655315 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f1c77abe-9f46-434c-b98c-5dc3f11cc8e8 req-93e4298d-98aa-46ef-b061-bb6c4540bb79 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 1100 time: 0.0916612 Aug 24 03:03:36.714796 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827bfc9d-dab2-4d1c-8968-b894d06e830a req-e2bf6ac4-88cd-487d-b71d-c1030cf1527f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:36.714796 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-827bfc9d-dab2-4d1c-8968-b894d06e830a req-e2bf6ac4-88cd-487d-b71d-c1030cf1527f service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 1099 time: 0.0940025 Aug 24 03:03:36.828224 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f1c77abe-9f46-434c-b98c-5dc3f11cc8e8 req-896767aa-8fa7-4627-9077-1d72f5a652a5 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1264520 Aug 24 03:03:36.854166 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:03:36.864755 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Sync routers for ids ['237f95eb-7035-4674-99ff-35e2f14fc035'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:03:36.878882 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827bfc9d-dab2-4d1c-8968-b894d06e830a req-21454cb5-b317-4521-8179-446636f886d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:36.880402 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-827bfc9d-dab2-4d1c-8968-b894d06e830a req-21454cb5-b317-4521-8179-446636f886d1 service neutron] 10.222.0.43 "GET /v2.0/networks?id=f35e751d-f371-4788-abda-6a58b8a779df HTTP/1.1" status: 200 len: 911 time: 0.1581793 Aug 24 03:03:36.884871 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Routers {'237f95eb-7035-4674-99ff-35e2f14fc035'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:03:36.885507 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:03:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['237f95eb-7035-4674-99ff-35e2f14fc035'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:36.970485 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] Notify callbacks [] for router, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:36.975515 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-f5714962-c5b6-4538-8100-a4b8eaa285fc admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.6054831 Aug 24 03:03:36.975683 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37136) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:37.001443 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Set router 237f95eb-7035-4674-99ff-35e2f14fc035 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:03:37.066275 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device c3dce199-252c-46ff-8b13-b023698467be up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:37.091438 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-577b065a-7d1d-4171-8635-1ab05ad64e47 req-ce1fc72f-bfca-4932-8c29-dc14f65979fa tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:37.093133 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-577b065a-7d1d-4171-8635-1ab05ad64e47 req-ce1fc72f-bfca-4932-8c29-dc14f65979fa tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 947 time: 0.0519903 Aug 24 03:03:37.132230 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-577b065a-7d1d-4171-8635-1ab05ad64e47 req-d6ec6280-7da3-4a2e-bc05-a693efb193da tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0322802 Aug 24 03:03:37.133476 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-827bfc9d-dab2-4d1c-8968-b894d06e830a req-bc6b334e-a50b-4d07-9140-019ccaa65ce1 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd HTTP/1.1" status: 200 len: 1002 time: 0.1068568 Aug 24 03:03:37.234499 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:03:35Z', 'revision_number': 3, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:37.244849 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827bfc9d-dab2-4d1c-8968-b894d06e830a req-d8c89678-20fc-403e-8c30-05ea4fbb7e25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:37.246453 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-827bfc9d-dab2-4d1c-8968-b894d06e830a req-d8c89678-20fc-403e-8c30-05ea4fbb7e25 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=14102a94-a55b-43e1-a7a9-4210a4c2e2fb HTTP/1.1" status: 200 len: 849 time: 0.1043670 Aug 24 03:03:37.260496 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port c3dce199-252c-46ff-8b13-b023698467be completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:37.262499 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Checking router: 237f95eb-7035-4674-99ff-35e2f14fc035 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:03:37.262852 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Updating router 237f95eb-7035-4674-99ff-35e2f14fc035 port 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 binding host dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:03:37.280927 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port c3dce199-252c-46ff-8b13-b023698467be triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:37.281300 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:37.312925 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:37.358209 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827bfc9d-dab2-4d1c-8968-b894d06e830a req-5197e863-d8cc-4ab4-ade5-4469f56b9e43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:37.359733 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-827bfc9d-dab2-4d1c-8968-b894d06e830a req-5197e863-d8cc-4ab4-ade5-4469f56b9e43 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=f35e751d-f371-4788-abda-6a58b8a779df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0874763 Aug 24 03:03:37.528707 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-827bfc9d-dab2-4d1c-8968-b894d06e830a req-4023670d-d5f3-4150-a8e0-8d79892dcdf8 service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1609378 Aug 24 03:03:37.617639 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:37.667371 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port c3dce199-252c-46ff-8b13-b023698467be, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=c3dce199-252c-46ff-8b13-b023698467be,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:37.688483 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-827bfc9d-dab2-4d1c-8968-b894d06e830a req-d0fb91d0-cdab-40cd-bd4d-4fcde5183e48 service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1471558 Aug 24 03:03:37.704122 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:37.743639 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:37.758781 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Notify callbacks [] for port, precommit_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:37.791822 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Transition to ACTIVE for port object 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:03:37.794013 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2296dbe-53b4-4672-8024-1851d46805cf req-f5819bea-2a15-4e8f-a23d-700d4e0b118b tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:37.795584 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b2296dbe-53b4-4672-8024-1851d46805cf req-f5819bea-2a15-4e8f-a23d-700d4e0b118b tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.1045933 Aug 24 03:03:37.812913 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=c3dce199-252c-46ff-8b13-b023698467be,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:37.870892 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:37.887103 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b2296dbe-53b4-4672-8024-1851d46805cf req-c43cf20c-3aaa-4d74-bb57-3de185ac2c98 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0785029 Aug 24 03:03:37.939726 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Allocated IP 172.20.0.1 (866d4604-551e-4da3-b89c-967338dbafff/4ffb6451-69cb-476e-bc2e-5b6165a067b1/a4f138f6-af08-4d87-a100-5579647b168d) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:03:37.945354 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Attempting to bind port 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:03:37.945916 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Attempting to bind port 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:03:37.946288 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Attempting to bind port 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 on network 63097abe-4b2c-457b-a244-629c1feb1fe5 {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:03:37.948339 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5224d82-60f3-4cea-85b0-83cf62897868 None None] Pushing event updated for resources: {'Port': ['ID=2a166f3b-bb0b-4491-b944-aa2b23edd1b6,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:37.955984 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:03:37.957068 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Checking segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:03:37.957068 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:37.957381 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Bound using segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:03:37.957849 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Bound port: 2a166f3b-bb0b-4491-b944-aa2b23edd1b6, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:03:37.958297 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:38.014824 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] For port 2a166f3b-bb0b-4491-b944-aa2b23edd1b6, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:03:38.018301 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] For port 2a166f3b-bb0b-4491-b944-aa2b23edd1b6, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=2a166f3b-bb0b-4491-b944-aa2b23edd1b6,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:03:38.060279 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:38.074749 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Transition to ACTIVE for port object a4f138f6-af08-4d87-a100-5579647b168d will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:03:38.158985 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:38.210489 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:38.211208 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Routers {'237f95eb-7035-4674-99ff-35e2f14fc035'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:03:38.211986 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:03:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['237f95eb-7035-4674-99ff-35e2f14fc035'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:38.278338 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5224d82-60f3-4cea-85b0-83cf62897868 None None] Pushing event updated for resources: {'Port': ['ID=2a166f3b-bb0b-4491-b944-aa2b23edd1b6,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:38.301995 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Network 866d4604-551e-4da3-b89c-967338dbafff is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:03:38.310010 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:38.314705 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:03:38.370194 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Pushing event updated for resources: {'Port': ['ID=a4f138f6-af08-4d87-a100-5579647b168d,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:38.384493 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] Set router 237f95eb-7035-4674-99ff-35e2f14fc035 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:03:38.395812 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df25bc1d-80cc-47cb-a752-29cd6bc681a0 req-57ae47f6-8ff9-4210-af3f-bab54361eb8e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:38.397362 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-df25bc1d-80cc-47cb-a752-29cd6bc681a0 req-57ae47f6-8ff9-4210-af3f-bab54361eb8e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 947 time: 0.1601880 Aug 24 03:03:38.400604 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-571748'] for router_interface, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:38.481821 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-df25bc1d-80cc-47cb-a752-29cd6bc681a0 req-0a1647a4-43fb-4ca3-af2a-da390e9090c9 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0770032 Aug 24 03:03:38.607079 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:03:35Z', 'revision_number': 3, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:38.633349 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:38.634569 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bdcf87e-7641-4af7-9520-2791dbb519d4 None None] The sync data for ids ['237f95eb-7035-4674-99ff-35e2f14fc035'] in dv-cinder-803748-8-iscsi is: [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:03:35Z', 'revision_number': 3, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:03:38.675719 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:38.790484 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-59620083-88a1-43b0-98e7-031cca76d086 None None] Provisioning for port a4f138f6-af08-4d87-a100-5579647b168d completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:38.798934 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-59620083-88a1-43b0-98e7-031cca76d086 None None] Provisioning complete for port a4f138f6-af08-4d87-a100-5579647b168d triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:38.798934 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-59620083-88a1-43b0-98e7-031cca76d086 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:38.838730 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-59620083-88a1-43b0-98e7-031cca76d086 None None] Port a4f138f6-af08-4d87-a100-5579647b168d cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:03:38.858443 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:38.968282 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:39.096945 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Pushing event updated for resources: {'Port': ['ID=a4f138f6-af08-4d87-a100-5579647b168d,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:39.106972 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-748278', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-571822'] for router_interface, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:39.148963 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device c3dce199-252c-46ff-8b13-b023698467be up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:39.220482 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port c3dce199-252c-46ff-8b13-b023698467be triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:39.220482 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:39.350401 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:39.432213 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d9cef0b-b6d5-4118-a0ca-5ebab0fcf01b req-4f1867b0-d4ef-49f1-b9c0-941d63bdacdc tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:39.433843 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7d9cef0b-b6d5-4118-a0ca-5ebab0fcf01b req-4f1867b0-d4ef-49f1-b9c0-941d63bdacdc tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.4309638 Aug 24 03:03:39.514946 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7d9cef0b-b6d5-4118-a0ca-5ebab0fcf01b req-2e4f6fb4-47d4-49db-ae9e-37fe24cc7d4a tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0528588 Aug 24 03:03:39.519891 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:39.525118 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:39.525859 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:39.546681 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Network 866d4604-551e-4da3-b89c-967338dbafff is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:03:39.546681 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:39.651981 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:39.683874 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port 2a166f3b-bb0b-4491-b944-aa2b23edd1b6, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=2a166f3b-bb0b-4491-b944-aa2b23edd1b6,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:39.699284 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0d37433-f1f7-4a9b-ab1d-0f04faa69a08 req-c2c6baa9-1d70-46e1-b34f-6e39d32a3f30 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:39.701521 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e0d37433-f1f7-4a9b-ab1d-0f04faa69a08 req-c2c6baa9-1d70-46e1-b34f-6e39d32a3f30 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 947 time: 0.0835516 Aug 24 03:03:39.728938 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Router 237f95eb-7035-4674-99ff-35e2f14fc035 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:03:39.748086 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e0d37433-f1f7-4a9b-ab1d-0f04faa69a08 req-6d2543b2-6a24-486f-a559-8bb797e83539 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0372519 Aug 24 03:03:39.790292 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:39.842723 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=2a166f3b-bb0b-4491-b944-aa2b23edd1b6,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:39.855566 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:03:39.861796 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-af2c7c8e-a4ef-40ff-b8cd-47e5f5b09129 admin admin] 10.222.0.30 "PUT /v2.0/routers/237f95eb-7035-4674-99ff-35e2f14fc035/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8836012 Aug 24 03:03:39.870541 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-701afabb-751a-4186-8b97-fad9ae1fc575 None None] Provisioning complete for port a4f138f6-af08-4d87-a100-5579647b168d triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:39.871263 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-701afabb-751a-4186-8b97-fad9ae1fc575 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:39.907374 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-701afabb-751a-4186-8b97-fad9ae1fc575 None None] Port a4f138f6-af08-4d87-a100-5579647b168d cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:03:40.336634 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Sync routers for ids ['237f95eb-7035-4674-99ff-35e2f14fc035'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:03:40.345711 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Routers {'237f95eb-7035-4674-99ff-35e2f14fc035'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:03:40.346317 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:03:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['237f95eb-7035-4674-99ff-35e2f14fc035'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:40.451326 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Set router 237f95eb-7035-4674-99ff-35e2f14fc035 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:03:40.610138 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37212) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:40.616684 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-509275593-network', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:40.653901 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:03:38Z', 'revision_number': 4, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'a4f138f6-af08-4d87-a100-5579647b168d', 'name': '', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'mac_address': 'fa:16:3e:c0:7f:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_interface', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:37Z', 'updated_at': '2021-08-24T03:03:38Z', 'revision_number': 2, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'subnets': [{'id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:40.682608 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Checking router: 237f95eb-7035-4674-99ff-35e2f14fc035 for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:03:40.682960 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Updating router 237f95eb-7035-4674-99ff-35e2f14fc035 port a4f138f6-af08-4d87-a100-5579647b168d binding host dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:03:40.707189 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:40.739560 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Made reservation on behalf of bfa136bdac864b3c8042aade77cf7ef3 for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:03:40.746731 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:40.750345 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:40.848149 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:40.872866 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f95d699-4d49-4c2a-96d2-62186d4d451d req-a9b3316e-7c78-4cb3-b727-2215f7e1981d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:40.874492 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6f95d699-4d49-4c2a-96d2-62186d4d451d req-a9b3316e-7c78-4cb3-b727-2215f7e1981d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 947 time: 0.0494311 Aug 24 03:03:40.924143 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6f95d699-4d49-4c2a-96d2-62186d4d451d req-7a4b7670-4a38-4de5-91db-91b1da3affc8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0423336 Aug 24 03:03:40.936407 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:40.967353 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] vlan segment allocate from pool success with {'vlan_id': 379, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:03:40.972685 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44c3d589-7fb4-4cbd-9a0d-c590bdd96077,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:40.982211 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:40.982560 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Added segment 492b5e01-c065-4d57-ac35-a87a91acff96 of type vlan for network 9cc245d7-39fd-4044-afad-289d6b54b8df Aug 24 03:03:41.030054 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:41.037005 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:41.074069 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Notify callbacks [] for port, precommit_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:41.083644 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.provisioning_blocks [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Transition to ACTIVE for port object a4f138f6-af08-4d87-a100-5579647b168d will not be triggered until provisioned by entity L2. {{(pid=111278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:03:41.085233 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:41.085712 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:41.161995 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:41.167363 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:41.167363 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:41.209078 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:41.224143 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] Pushing event updated for resources: {'Network': ['ID=9cc245d7-39fd-4044-afad-289d6b54b8df,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:41.255384 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 9cc245d7-39fd-4044-afad-289d6b54b8df details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:03:41.259584 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Pushing event updated for resources: {'Port': ['ID=a4f138f6-af08-4d87-a100-5579647b168d,revision_number=3']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:41.269492 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:41.270186 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:41.270830 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:41.271259 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:41.271686 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:41.272171 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:41.272595 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:41.273043 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:41.273479 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:41.273922 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:41.274472 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:41.274988 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:41.308806 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-95d1d722-e861-4250-83b3-e381f501eabd admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.6974919 Aug 24 03:03:41.311863 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37220) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:41.319015 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-44cf9b1a-eb13-46bf-b8da-3ca4d43b9f9e admin admin] Request body: {'subnet': {'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-509275593-subnet', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'ip_version': 4}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:41.332751 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Attempting to bind port a4f138f6-af08-4d87-a100-5579647b168d on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:03:41.333452 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Attempting to bind port a4f138f6-af08-4d87-a100-5579647b168d by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:03:41.333934 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Attempting to bind port a4f138f6-af08-4d87-a100-5579647b168d on network 866d4604-551e-4da3-b89c-967338dbafff {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:03:41.339122 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:03:41.339762 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Checking segment: {'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:03:41.340044 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:41.346164 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Bound using segment: {'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:03:41.346164 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Bound port: a4f138f6-af08-4d87-a100-5579647b168d, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'}}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:03:41.346164 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:41.406464 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] For port a4f138f6-af08-4d87-a100-5579647b168d, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:03:41.409543 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] For port a4f138f6-af08-4d87-a100-5579647b168d, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=a4f138f6-af08-4d87-a100-5579647b168d,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:03:41.430256 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44cf9b1a-eb13-46bf-b8da-3ca4d43b9f9e admin admin] Made reservation on behalf of bfa136bdac864b3c8042aade77cf7ef3 for: {'subnet': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:03:41.432571 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-44cf9b1a-eb13-46bf-b8da-3ca4d43b9f9e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3378795'] for subnet, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:41.511077 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:41.570069 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Routers {'237f95eb-7035-4674-99ff-35e2f14fc035'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:03:41.570701 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:03:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['237f95eb-7035-4674-99ff-35e2f14fc035'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:41.573688 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f34815c-1eae-4629-9413-c0ed4a8919d3 None None] Pushing event updated for resources: {'Port': ['ID=a4f138f6-af08-4d87-a100-5579647b168d,revision_number=4']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:41.673399 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-44cf9b1a-eb13-46bf-b8da-3ca4d43b9f9e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483122', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3378713'] for subnet, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:41.680919 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] Set router 237f95eb-7035-4674-99ff-35e2f14fc035 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:03:41.740482 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44cf9b1a-eb13-46bf-b8da-3ca4d43b9f9e admin admin] Pushing event updated for resources: {'Subnet': ['ID=590a81da-5183-4161-b5dd-71e21ddf0164,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:41.745835 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44cf9b1a-eb13-46bf-b8da-3ca4d43b9f9e admin admin] Checking segment: {'id': '492b5e01-c065-4d57-ac35-a87a91acff96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:03:41.746177 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44cf9b1a-eb13-46bf-b8da-3ca4d43b9f9e admin admin] Network hostable DHCP agents. Network: 9cc245d7-39fd-4044-afad-289d6b54b8df, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111275) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:03:41.835812 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44cf9b1a-eb13-46bf-b8da-3ca4d43b9f9e admin admin] Network 9cc245d7-39fd-4044-afad-289d6b54b8df is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111275) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:03:41.882526 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:03:38Z', 'revision_number': 4, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'a4f138f6-af08-4d87-a100-5579647b168d', 'name': '', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'mac_address': 'fa:16:3e:c0:7f:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_interface', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:37Z', 'updated_at': '2021-08-24T03:03:41Z', 'revision_number': 4, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'subnets': [{'id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:41.907844 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d2b3993-4acb-46ed-a0a3-38df2b648409 None None] The sync data for ids ['237f95eb-7035-4674-99ff-35e2f14fc035'] in dv-cinder-803748-8-iscsi is: [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:03:38Z', 'revision_number': 4, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'a4f138f6-af08-4d87-a100-5579647b168d', 'name': '', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'mac_address': 'fa:16:3e:c0:7f:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_interface', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:37Z', 'updated_at': '2021-08-24T03:03:41Z', 'revision_number': 4, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'subnets': [{'id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:03:41.918824 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-44cf9b1a-eb13-46bf-b8da-3ca4d43b9f9e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 9cc245d7-39fd-4044-afad-289d6b54b8df) {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:41.923165 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44cf9b1a-eb13-46bf-b8da-3ca4d43b9f9e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:41.924110 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-44cf9b1a-eb13-46bf-b8da-3ca4d43b9f9e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:41.928058 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef11e56e-d7b9-406b-8e13-999993cec10a None None] Network 9cc245d7-39fd-4044-afad-289d6b54b8df requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:03:42.008391 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-44cf9b1a-eb13-46bf-b8da-3ca4d43b9f9e admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.6954925 Aug 24 03:03:42.011379 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37222) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:42.017119 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-509275593-router', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:42.101231 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc8ebca0a-8efd-5c96-8278-1a4ec08c6f82-9cc245d7-39fd-4044-afad-289d6b54b8df', 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'fixed_ips': [{'subnet_id': '590a81da-5183-4161-b5dd-71e21ddf0164'}]}} from dv-cinder-803748-8-iscsi. {{(pid=111277) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Aug 24 03:03:42.102221 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:42.114451 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-560365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32717'] for router, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:42.115557 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-560249', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-569518', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-437890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32692'] for router, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:42.169860 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:42.240632 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.db_base_plugin_common [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Allocated IP 172.20.0.2 (9cc245d7-39fd-4044-afad-289d6b54b8df/590a81da-5183-4161-b5dd-71e21ddf0164/973a85b5-51a5-496d-97a0-dbf1b5b101fc) {{(pid=111277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:03:42.393127 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Notify callbacks [] for port, precommit_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:42.402256 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Transition to ACTIVE for port object 973a85b5-51a5-496d-97a0-dbf1b5b101fc will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:03:42.417201 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Transition to ACTIVE for port object 973a85b5-51a5-496d-97a0-dbf1b5b101fc will not be triggered until provisioned by entity DHCP. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:03:42.444138 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:42.488102 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:42.527091 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Network 9cc245d7-39fd-4044-afad-289d6b54b8df is already hosted by enough agents. {{(pid=111277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:03:42.529921 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.base_scheduler [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Resources bound (agent type, host, resource id): {{(pid=111277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:42.533287 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Received port after_create {{(pid=111277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:03:42.543370 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Pushing event updated for resources: {'Port': ['ID=973a85b5-51a5-496d-97a0-dbf1b5b101fc,revision_number=1']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:42.608299 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Attempting to bind port 973a85b5-51a5-496d-97a0-dbf1b5b101fc on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:03:42.608754 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Attempting to bind port 973a85b5-51a5-496d-97a0-dbf1b5b101fc by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '492b5e01-c065-4d57-ac35-a87a91acff96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:03:42.609204 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Attempting to bind port 973a85b5-51a5-496d-97a0-dbf1b5b101fc on network 9cc245d7-39fd-4044-afad-289d6b54b8df {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:03:42.620617 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:03:42.621001 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Checking segment: {'id': '492b5e01-c065-4d57-ac35-a87a91acff96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:03:42.621409 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:42.621846 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Bound using segment: {'id': '492b5e01-c065-4d57-ac35-a87a91acff96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:03:42.622319 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Bound port: 973a85b5-51a5-496d-97a0-dbf1b5b101fc, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '492b5e01-c065-4d57-ac35-a87a91acff96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:03:42.622703 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:42.689654 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] For port 973a85b5-51a5-496d-97a0-dbf1b5b101fc, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:03:42.693770 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] For port 973a85b5-51a5-496d-97a0-dbf1b5b101fc, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=973a85b5-51a5-496d-97a0-dbf1b5b101fc,segment=NetworkSegment(492b5e01-c065-4d57-ac35-a87a91acff96),segment_id=492b5e01-c065-4d57-ac35-a87a91acff96)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:03:42.734955 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:42.754919 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:42.789014 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:42.865104 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42db7aa2-c0fd-4d78-849e-d4a0dd34ee31 None None] Pushing event updated for resources: {'Port': ['ID=973a85b5-51a5-496d-97a0-dbf1b5b101fc,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:42.887236 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Allocated IP 172.27.2.92 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/f0e6a540-50a9-4d61-83d7-75392acbd6c0) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:03:43.020986 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:43.104547 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device a4f138f6-af08-4d87-a100-5579647b168d up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:43.146308 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:43.183092 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:03:43.186061 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:43.189355 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:03:43.214793 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Pushing event updated for resources: {'Port': ['ID=f0e6a540-50a9-4d61-83d7-75392acbd6c0,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:43.240320 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port a4f138f6-af08-4d87-a100-5579647b168d completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:43.242207 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port a4f138f6-af08-4d87-a100-5579647b168d triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:43.242654 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:43.328588 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:43.367273 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port a4f138f6-af08-4d87-a100-5579647b168d, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=a4f138f6-af08-4d87-a100-5579647b168d,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:43.444496 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:43.494437 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=a4f138f6-af08-4d87-a100-5579647b168d,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:43.519072 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:43.724491 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-560242', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-569595'] for router, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:43.748517 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91f034ae-48dd-43ba-a7ad-c69a0c35ef30 None None] Network 9cc245d7-39fd-4044-afad-289d6b54b8df requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:03:43.904586 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-de5c58f9-ad2f-41e6-be09-02b0a598635f None None] Provisioning for port 973a85b5-51a5-496d-97a0-dbf1b5b101fc completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:43.933640 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Router aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c is scheduled to L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 with binding_index 1 {{(pid=111276) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Aug 24 03:03:44.046561 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:03:44.055913 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Sync routers for ids ['aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:03:44.065154 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Routers {'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:03:44.066435 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:03:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:44.170576 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] Notify callbacks [] for router, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:44.171799 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-a253e909-0cf2-4804-9d7c-9fb4bd863f79 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.1587570 Aug 24 03:03:44.174651 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37230) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:44.299954 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Set router aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:03:44.484138 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'name': 'tempest-TestShelveInstance-509275593-router', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92'}], 'enable_snat': True}, 'gw_port_id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:43Z', 'revision_number': 3, 'project_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'gw_port': {'id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:3e:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:44.512104 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Checking router: aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:03:44.512447 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Updating router aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c port f0e6a540-50a9-4d61-83d7-75392acbd6c0 binding host dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:03:44.538642 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:44.797840 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Notify callbacks [] for port, precommit_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:44.807858 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Transition to ACTIVE for port object f0e6a540-50a9-4d61-83d7-75392acbd6c0 will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:03:44.826025 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:44.889958 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:44.947373 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Attempting to bind port f0e6a540-50a9-4d61-83d7-75392acbd6c0 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:03:44.947772 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Attempting to bind port f0e6a540-50a9-4d61-83d7-75392acbd6c0 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:03:44.948048 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Attempting to bind port f0e6a540-50a9-4d61-83d7-75392acbd6c0 on network 63097abe-4b2c-457b-a244-629c1feb1fe5 {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:03:44.955774 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04d7fd47-910c-4696-adaf-b361939fba07 None None] Pushing event updated for resources: {'Port': ['ID=f0e6a540-50a9-4d61-83d7-75392acbd6c0,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:44.960435 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:03:44.960817 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Checking segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:03:44.961222 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:44.961628 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Bound using segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:03:44.962098 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Bound port: f0e6a540-50a9-4d61-83d7-75392acbd6c0, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:03:44.962481 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:44.998650 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Allocated IP 172.20.0.1 (9cc245d7-39fd-4044-afad-289d6b54b8df/590a81da-5183-4161-b5dd-71e21ddf0164/da408c70-a5b7-41ab-b17e-9b4b0a3b8efd) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:03:45.017766 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] For port f0e6a540-50a9-4d61-83d7-75392acbd6c0, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:03:45.021262 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] For port f0e6a540-50a9-4d61-83d7-75392acbd6c0, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=f0e6a540-50a9-4d61-83d7-75392acbd6c0,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:03:45.109001 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.109818 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 973a85b5-51a5-496d-97a0-dbf1b5b101fc up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:45.114860 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.124393 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Transition to ACTIVE for port object da408c70-a5b7-41ab-b17e-9b4b0a3b8efd will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:03:45.208230 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Routers {'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:03:45.208841 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:03:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:45.212522 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04d7fd47-910c-4696-adaf-b361939fba07 None None] Pushing event updated for resources: {'Port': ['ID=f0e6a540-50a9-4d61-83d7-75392acbd6c0,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:45.219403 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.257654 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Network 9cc245d7-39fd-4044-afad-289d6b54b8df is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:03:45.260363 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:45.263743 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:03:45.288575 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Pushing event updated for resources: {'Port': ['ID=da408c70-a5b7-41ab-b17e-9b4b0a3b8efd,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:45.307845 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-571748'] for router_interface, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.308576 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 973a85b5-51a5-496d-97a0-dbf1b5b101fc completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:45.318727 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 973a85b5-51a5-496d-97a0-dbf1b5b101fc triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:45.319165 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.347192 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] Set router aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:03:45.521642 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.538373 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.600652 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port 973a85b5-51a5-496d-97a0-dbf1b5b101fc, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=973a85b5-51a5-496d-97a0-dbf1b5b101fc,segment=NetworkSegment(492b5e01-c065-4d57-ac35-a87a91acff96),segment_id=492b5e01-c065-4d57-ac35-a87a91acff96)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:45.603026 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-754da1aa-2b27-42aa-a080-94ce18d99278 None None] Provisioning for port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:45.608791 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-754da1aa-2b27-42aa-a080-94ce18d99278 None None] Provisioning complete for port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:45.609170 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-754da1aa-2b27-42aa-a080-94ce18d99278 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.651329 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-754da1aa-2b27-42aa-a080-94ce18d99278 None None] Port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:03:45.653564 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'name': 'tempest-TestShelveInstance-509275593-router', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92'}], 'enable_snat': True}, 'gw_port_id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:43Z', 'revision_number': 3, 'project_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'gw_port': {'id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:3e:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:45.680563 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6af1e706-796f-467c-95e2-c8c8c5b1deea None None] The sync data for ids ['aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'] in dv-cinder-803748-8-iscsi is: [{'id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'name': 'tempest-TestShelveInstance-509275593-router', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92'}], 'enable_snat': True}, 'gw_port_id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:43Z', 'revision_number': 3, 'project_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'gw_port': {'id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:3e:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:03:45.684373 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.702135 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.702981 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device a4f138f6-af08-4d87-a100-5579647b168d up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:45.764117 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.780656 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=973a85b5-51a5-496d-97a0-dbf1b5b101fc,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:45.794018 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port a4f138f6-af08-4d87-a100-5579647b168d triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:45.794409 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.832690 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Pushing event updated for resources: {'Port': ['ID=da408c70-a5b7-41ab-b17e-9b4b0a3b8efd,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:45.835172 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-748278', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-571822'] for router_interface, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:45.952841 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Network 9cc245d7-39fd-4044-afad-289d6b54b8df is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:03:45.954233 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:46.091306 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Router aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:03:46.173962 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-62bb0a87-f406-4b14-b5ff-c6d7ac8784f7 None None] Provisioning complete for port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:46.174390 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-62bb0a87-f406-4b14-b5ff-c6d7ac8784f7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:46.211646 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-62bb0a87-f406-4b14-b5ff-c6d7ac8784f7 None None] Port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:03:46.218861 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:03:46.223982 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-3308331a-b622-45e6-a1ba-0d83cfccf37f admin admin] 10.222.0.30 "PUT /v2.0/routers/aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0482676 Aug 24 03:03:46.795612 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-af29bea1-ba57-4488-a7d6-79586f8d3f59 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:46.797086 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-af29bea1-ba57-4488-a7d6-79586f8d3f59 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/networks?id=a8a02a2d-c194-4f2f-9653-b6e128589efc HTTP/1.1" status: 200 len: 815 time: 0.1005657 Aug 24 03:03:46.812108 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-e4d97963-3cd4-4686-9a0b-4194f8d143c2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/quotas/18e124ea63a5483aba6b8f112a4d4b33 HTTP/1.1" status: 200 len: 375 time: 0.0091453 Aug 24 03:03:46.864222 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-424e7b33-a326-4339-bb9a-64eb64ef6a65 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0466409 Aug 24 03:03:46.963084 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5e1a6773-edab-4471-b0f0-654df40d0494 service neutron] 10.222.0.30 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0906246 Aug 24 03:03:47.064374 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-b7c49593-72b5-47cb-827b-25be824a65cc service neutron] 10.222.0.30 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0942891 Aug 24 03:03:47.092105 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device f0e6a540-50a9-4d61-83d7-75392acbd6c0 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:47.251641 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port f0e6a540-50a9-4d61-83d7-75392acbd6c0 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:47.255052 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port f0e6a540-50a9-4d61-83d7-75392acbd6c0 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:47.255445 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:47.275435 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Sync routers for ids ['aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:03:47.284873 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Routers {'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:03:47.285606 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:03:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:47.343402 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:47.366643 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port f0e6a540-50a9-4d61-83d7-75392acbd6c0, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=f0e6a540-50a9-4d61-83d7-75392acbd6c0,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:47.374254 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1c13382e-a86a-4072-97ee-096811b2bf84 req-22de75fa-35e7-48cc-8862-e399516c9031 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 210 time: 0.0340297 Aug 24 03:03:47.408282 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Set router aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:03:47.421442 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:47.422337 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 973a85b5-51a5-496d-97a0-dbf1b5b101fc up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:47.506424 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=f0e6a540-50a9-4d61-83d7-75392acbd6c0,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:47.522356 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 973a85b5-51a5-496d-97a0-dbf1b5b101fc triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:47.522669 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:47.612026 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'name': 'tempest-TestShelveInstance-509275593-router', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92'}], 'enable_snat': True}, 'gw_port_id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:45Z', 'revision_number': 4, 'project_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'gw_port': {'id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:3e:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'da408c70-a5b7-41ab-b17e-9b4b0a3b8efd', 'name': '', 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'mac_address': 'fa:16:3e:82:f9:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'device_owner': 'network:router_interface', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '590a81da-5183-4161-b5dd-71e21ddf0164', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:44Z', 'updated_at': '2021-08-24T03:03:45Z', 'revision_number': 2, 'project_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'subnets': [{'id': '590a81da-5183-4161-b5dd-71e21ddf0164', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:47.648920 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Checking router: aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:03:47.649411 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Updating router aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd binding host dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:03:47.673685 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:47.871111 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37270) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:47.875799 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-b08934f4-4af1-4d47-853f-0b04ee37d1b9 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-433000894', 'description': 'tempest-secgroup-smoke-433000894 description', 'project_id': '8bca2ab0549a4f099c2421571c26f61b'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:47.939698 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Notify callbacks [] for port, precommit_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:47.949730 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.provisioning_blocks [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Transition to ACTIVE for port object da408c70-a5b7-41ab-b17e-9b4b0a3b8efd will not be triggered until provisioned by entity L2. {{(pid=111278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:03:47.996170 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b08934f4-4af1-4d47-853f-0b04ee37d1b9 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:48.076413 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b08934f4-4af1-4d47-853f-0b04ee37d1b9 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:48.087282 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:48.141908 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe6b75fc-bb9e-4ed0-a076-16fc6515a63a None None] Pushing event updated for resources: {'Port': ['ID=da408c70-a5b7-41ab-b17e-9b4b0a3b8efd,revision_number=3']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:48.188448 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Attempting to bind port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:03:48.188821 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Attempting to bind port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '492b5e01-c065-4d57-ac35-a87a91acff96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df'}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:03:48.189185 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Attempting to bind port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd on network 9cc245d7-39fd-4044-afad-289d6b54b8df {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:03:48.194349 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 3, 24), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:03:48.194725 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Checking segment: {'id': '492b5e01-c065-4d57-ac35-a87a91acff96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:03:48.195131 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:48.195526 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Bound using segment: {'id': '492b5e01-c065-4d57-ac35-a87a91acff96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df'} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:03:48.196000 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Bound port: da408c70-a5b7-41ab-b17e-9b4b0a3b8efd, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '492b5e01-c065-4d57-ac35-a87a91acff96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 379, 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df'}}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:03:48.196399 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:48.260143 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] For port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:03:48.263271 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] For port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=da408c70-a5b7-41ab-b17e-9b4b0a3b8efd,segment=NetworkSegment(492b5e01-c065-4d57-ac35-a87a91acff96),segment_id=492b5e01-c065-4d57-ac35-a87a91acff96)] {{(pid=111278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:03:48.292886 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b08934f4-4af1-4d47-853f-0b04ee37d1b9 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:48.320897 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08934f4-4af1-4d47-853f-0b04ee37d1b9 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e415ccde-c5f3-41fa-a088-107816b2da10,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:48.411153 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:48.465138 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-698d2104-6d0f-4841-9fe7-a1d54e6e81d1 req-3aa2af23-feae-40fb-8f54-0686fde5ed02 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 210 time: 0.0279355 Aug 24 03:03:48.471323 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Routers {'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:03:48.471987 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:03:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:48.498885 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b08934f4-4af1-4d47-853f-0b04ee37d1b9 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:48.503071 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-b08934f4-4af1-4d47-853f-0b04ee37d1b9 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.6281950 Aug 24 03:03:48.503302 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37274) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:48.506968 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe6b75fc-bb9e-4ed0-a076-16fc6515a63a None None] Pushing event updated for resources: {'Port': ['ID=da408c70-a5b7-41ab-b17e-9b4b0a3b8efd,revision_number=4']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:48.509714 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-5df7a473-6a5c-4efd-9a99-7c4e7f63c5a0 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Request body: {'security_group_rule': {'security_group_id': 'e415ccde-c5f3-41fa-a088-107816b2da10', 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:48.592358 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] Set router aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:03:48.608653 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-5df7a473-6a5c-4efd-9a99-7c4e7f63c5a0 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:48.678406 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-5df7a473-6a5c-4efd-9a99-7c4e7f63c5a0 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:48.771636 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-5df7a473-6a5c-4efd-9a99-7c4e7f63c5a0 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:48.795498 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5df7a473-6a5c-4efd-9a99-7c4e7f63c5a0 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3ba72174-1296-452c-9b03-81e89cf2f969,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:48.870388 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-5df7a473-6a5c-4efd-9a99-7c4e7f63c5a0 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:48.871593 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-5df7a473-6a5c-4efd-9a99-7c4e7f63c5a0 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3672297 Aug 24 03:03:48.874513 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37276) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:48.877294 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'name': 'tempest-TestShelveInstance-509275593-router', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92'}], 'enable_snat': True}, 'gw_port_id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:45Z', 'revision_number': 4, 'project_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'gw_port': {'id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:3e:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'da408c70-a5b7-41ab-b17e-9b4b0a3b8efd', 'name': '', 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'mac_address': 'fa:16:3e:82:f9:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'device_owner': 'network:router_interface', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '590a81da-5183-4161-b5dd-71e21ddf0164', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:44Z', 'updated_at': '2021-08-24T03:03:48Z', 'revision_number': 4, 'project_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'subnets': [{'id': '590a81da-5183-4161-b5dd-71e21ddf0164', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:03:48.879983 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-8ba24cec-9960-48bb-90af-9f8eaa09b60d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Request body: {'security_group_rule': {'security_group_id': 'e415ccde-c5f3-41fa-a088-107816b2da10', 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:48.903979 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48a049c-c34c-4abf-bfc8-6f33499e0489 None None] The sync data for ids ['aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'] in dv-cinder-803748-8-iscsi is: [{'id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'name': 'tempest-TestShelveInstance-509275593-router', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92'}], 'enable_snat': True}, 'gw_port_id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:45Z', 'revision_number': 4, 'project_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'gw_port': {'id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:3e:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'da408c70-a5b7-41ab-b17e-9b4b0a3b8efd', 'name': '', 'network_id': '9cc245d7-39fd-4044-afad-289d6b54b8df', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'mac_address': 'fa:16:3e:82:f9:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'device_owner': 'network:router_interface', 'standard_attr_id': 443, 'fixed_ips': [{'subnet_id': '590a81da-5183-4161-b5dd-71e21ddf0164', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:44Z', 'updated_at': '2021-08-24T03:03:48Z', 'revision_number': 4, 'project_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'subnets': [{'id': '590a81da-5183-4161-b5dd-71e21ddf0164', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:03:49.031782 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device f0e6a540-50a9-4d61-83d7-75392acbd6c0 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:49.038634 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8ba24cec-9960-48bb-90af-9f8eaa09b60d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:49.088835 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port f0e6a540-50a9-4d61-83d7-75392acbd6c0 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:49.089207 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:49.107743 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8ba24cec-9960-48bb-90af-9f8eaa09b60d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:49.235754 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8ba24cec-9960-48bb-90af-9f8eaa09b60d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:49.253753 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ba24cec-9960-48bb-90af-9f8eaa09b60d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=407989cb-37a9-4b7d-8184-7d18e8ea67fd,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:49.361698 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8ba24cec-9960-48bb-90af-9f8eaa09b60d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:49.363147 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-8ba24cec-9960-48bb-90af-9f8eaa09b60d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.4875309 Aug 24 03:03:49.366096 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37278) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:49.370556 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Request body: {'security_group_rule': {'security_group_id': 'e415ccde-c5f3-41fa-a088-107816b2da10', 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:49.496093 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:49.565429 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-84ae9a71-6f91-4b3e-866c-f30d1a8fb563 req-2770774e-9055-4352-8c67-55f2c935695d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 210 time: 0.0280349 Aug 24 03:03:49.627819 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:49.687253 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-693ed560-7ccb-4c2d-93ab-06a3ce0d5fd8 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:49.688741 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-693ed560-7ccb-4c2d-93ab-06a3ce0d5fd8 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "GET /v2.0/networks?id=a8a02a2d-c194-4f2f-9653-b6e128589efc HTTP/1.1" status: 200 len: 815 time: 0.1249421 Aug 24 03:03:49.704517 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Request body: {'port': {'device_id': '62e2db1f-a628-41d4-bc7a-eed2965da9d4', 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc', 'admin_state_up': True, 'tenant_id': '18e124ea63a5483aba6b8f112a4d4b33'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:49.709774 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:49.767897 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cf138853-e6e3-487f-ad92-f5c1308ca56f,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:49.780890 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:49.781424 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:49.781805 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:49.782142 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:49.785363 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:49.785363 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:49.785363 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:49.785363 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:49.785363 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:49.785363 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:49.785363 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:49.785363 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:03:49.857372 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:49.858600 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-bade8acf-a9ce-4f32-ac97-79b57dfca40e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4915652 Aug 24 03:03:49.861357 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37284) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:49.866337 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-2b76a26b-3495-4b75-8c1d-fec3701fd5b8 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Request body: {'security_group_rule': {'security_group_id': 'e415ccde-c5f3-41fa-a088-107816b2da10', 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:49.977653 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Made reservation on behalf of 18e124ea63a5483aba6b8f112a4d4b33 for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:03:49.981317 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.120476 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Allocated IP 172.20.0.10 (a8a02a2d-c194-4f2f-9653-b6e128589efc/05cef140-037d-459e-a03d-a6915273f9d4/c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:03:50.124615 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2b76a26b-3495-4b75-8c1d-fec3701fd5b8 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.251448 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2b76a26b-3495-4b75-8c1d-fec3701fd5b8 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.306437 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.358665 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2b76a26b-3495-4b75-8c1d-fec3701fd5b8 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.376943 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b76a26b-3495-4b75-8c1d-fec3701fd5b8 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8eab4555-4cb7-441b-a6d6-6b63a765469f,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:50.442661 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.454873 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['450b43c8-80f4-420a-a8ae-14a79c1f2644'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:03:50.476776 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2b76a26b-3495-4b75-8c1d-fec3701fd5b8 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.481012 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-2b76a26b-3495-4b75-8c1d-fec3701fd5b8 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6156497 Aug 24 03:03:50.481188 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37290) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:50.485548 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Network a8a02a2d-c194-4f2f-9653-b6e128589efc is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:03:50.486580 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-4b13d779-d284-4bb5-a4a3-fb30e29c7639 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Request body: {'security_group_rule': {'security_group_id': 'e415ccde-c5f3-41fa-a088-107816b2da10', 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:50.489465 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:03:50.493171 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:03:50.501750 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Pushing event updated for resources: {'Port': ['ID=c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:50.547469 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:50.548180 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.595654 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.securitygroups_db [None req-4b13d779-d284-4bb5-a4a3-fb30e29c7639 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Project 8bca2ab0549a4f099c2421571c26f61b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Aug 24 03:03:50.602326 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4b13d779-d284-4bb5-a4a3-fb30e29c7639 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.673784 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c11c67e7-b8f4-4b29-8e01-da053477748d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9731467 Aug 24 03:03:50.675698 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4b13d779-d284-4bb5-a4a3-fb30e29c7639 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.686579 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Request body: {'port': {'device_id': '62e2db1f-a628-41d4-bc7a-eed2965da9d4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:50.716543 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4465b39-e499-467c-b9e2-3f7db8da57a8 req-67a7c897-915c-468a-8560-3a0f396c3cd1 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:50.718081 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a4465b39-e499-467c-b9e2-3f7db8da57a8 req-67a7c897-915c-468a-8560-3a0f396c3cd1 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 932 time: 0.0775366 Aug 24 03:03:50.752811 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4b13d779-d284-4bb5-a4a3-fb30e29c7639 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.772246 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.776330 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b13d779-d284-4bb5-a4a3-fb30e29c7639 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=eecc73d3-e943-4647-88ae-ac3166ee9a61,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:50.787298 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a4465b39-e499-467c-b9e2-3f7db8da57a8 req-21866f1f-ea64-4180-aae9-78db4071868d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617483 Aug 24 03:03:50.841449 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4b13d779-d284-4bb5-a4a3-fb30e29c7639 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:50.842740 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-4b13d779-d284-4bb5-a4a3-fb30e29c7639 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3601785 Aug 24 03:03:50.845512 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37294) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:03:50.850069 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-8242abe0-04b2-4af7-8ee5-1ec4cf2ab832 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Request body: {'security_group_rule': {'security_group_id': 'e415ccde-c5f3-41fa-a088-107816b2da10', 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:03:50.942862 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.securitygroups_db [None req-8242abe0-04b2-4af7-8ee5-1ec4cf2ab832 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Project 8bca2ab0549a4f099c2421571c26f61b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Aug 24 03:03:50.950655 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8242abe0-04b2-4af7-8ee5-1ec4cf2ab832 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.034836 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8242abe0-04b2-4af7-8ee5-1ec4cf2ab832 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.047257 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device da408c70-a5b7-41ab-b17e-9b4b0a3b8efd up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:51.054512 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:03:51.062367 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.074894 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Transition to ACTIVE for port object c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:03:51.158449 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8242abe0-04b2-4af7-8ee5-1ec4cf2ab832 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.178709 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8242abe0-04b2-4af7-8ee5-1ec4cf2ab832 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1364f68e-f110-452c-81ad-aa21eafa792a,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:51.215804 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:51.215979 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.219768 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:51.220118 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.267049 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Pushing event updated for resources: {'Port': ['ID=c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:51.276876 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8242abe0-04b2-4af7-8ee5-1ec4cf2ab832 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.284165 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-8242abe0-04b2-4af7-8ee5-1ec4cf2ab832 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4317355 Aug 24 03:03:51.299657 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.335390 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Attempting to bind port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:03:51.335741 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Attempting to bind port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:03:51.336311 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Attempting to bind port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d on network a8a02a2d-c194-4f2f-9653-b6e128589efc {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:03:51.340507 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d on network a8a02a2d-c194-4f2f-9653-b6e128589efc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:03:51.340829 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Attempting to bind port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d on network a8a02a2d-c194-4f2f-9653-b6e128589efc {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:03:51.347865 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=da408c70-a5b7-41ab-b17e-9b4b0a3b8efd,segment=NetworkSegment(492b5e01-c065-4d57-ac35-a87a91acff96),segment_id=492b5e01-c065-4d57-ac35-a87a91acff96)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:51.348768 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 3, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:03:51.349109 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Checking segment: {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:03:51.349542 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Bound using segment: {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:03:51.350028 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Bound port: c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:03:51.350348 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.420679 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] For port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:03:51.423893 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] For port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:03:51.435887 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-232cb5b7-20f0-4aab-9217-24df1eece633 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.469940 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.504953 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.523689 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=da408c70-a5b7-41ab-b17e-9b4b0a3b8efd,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:51.538879 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:51.539064 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:51.540517 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] 10.222.0.43 "PUT /v2.0/ports/c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d HTTP/1.1" status: 200 len: 1094 time: 0.8582361 Aug 24 03:03:51.542808 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '62e2db1f-a628-41d4-bc7a-eed2965da9d4', 'tag': 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:03:51.545036 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c77c03d6-ab38-4ded-b399-d561f27a6bd2" -d '{"events": [{"name": "network-changed", "server_uuid": "62e2db1f-a628-41d4-bc7a-eed2965da9d4", "tag": "c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:03:51.578592 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5af011e1-4d4f-4c14-92b9-57c03e46fcd3 service neutron] Pushing event updated for resources: {'Port': ['ID=c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:51.592433 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:03:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e04e60c-a1e2-4d51-b1d3-721c841fd5c7 x-openstack-request-id: req-1e04e60c-a1e2-4d51-b1d3-721c841fd5c7 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:03:51.592718 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "62e2db1f-a628-41d4-bc7a-eed2965da9d4", "tag": "c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:03:51.592978 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-1e04e60c-a1e2-4d51-b1d3-721c841fd5c7 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:03:51.593355 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '62e2db1f-a628-41d4-bc7a-eed2965da9d4', 'tag': 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d', 'status': 'completed', 'code': 200} Aug 24 03:03:51.655126 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c77c03d6-ab38-4ded-b399-d561f27a6bd2 req-0f5e536a-04c5-4f27-a914-7d0415808937 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:51.656598 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c77c03d6-ab38-4ded-b399-d561f27a6bd2 req-0f5e536a-04c5-4f27-a914-7d0415808937 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 1097 time: 0.0422978 Aug 24 03:03:51.756440 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c77c03d6-ab38-4ded-b399-d561f27a6bd2 req-f68a3368-a5ee-427c-9cb1-ca6a4b999cf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:51.757917 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c77c03d6-ab38-4ded-b399-d561f27a6bd2 req-f68a3368-a5ee-427c-9cb1-ca6a4b999cf0 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0924501 Aug 24 03:03:51.856980 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c77c03d6-ab38-4ded-b399-d561f27a6bd2 req-de4079f5-d80e-46d3-abf8-9dde4eb3ed22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:51.858412 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c77c03d6-ab38-4ded-b399-d561f27a6bd2 req-de4079f5-d80e-46d3-abf8-9dde4eb3ed22 service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0902116 Aug 24 03:03:51.905169 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-430282a9-bfea-4d12-b6b1-0b598607694d req-d7a6d1f0-7dd9-4ce3-bb1a-59a66ef7b6b3 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:51.906645 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-430282a9-bfea-4d12-b6b1-0b598607694d req-d7a6d1f0-7dd9-4ce3-bb1a-59a66ef7b6b3 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 944 time: 0.0520205 Aug 24 03:03:51.973668 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-430282a9-bfea-4d12-b6b1-0b598607694d req-091a8b4e-29af-4808-9476-ff4a30eec4fc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579324 Aug 24 03:03:51.976133 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c8f42ce5-ea30-4f77-bfb0-6f2d6e15e91c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:51.977521 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-c8f42ce5-ea30-4f77-bfb0-6f2d6e15e91c service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 1097 time: 0.0699344 Aug 24 03:03:52.025786 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-f049a8a2-e183-4730-937c-495da75173ca service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d HTTP/1.1" status: 200 len: 217 time: 0.0378437 Aug 24 03:03:52.077781 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-2d3121e7-cb84-4248-aaa8-8df06eed94b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:52.079204 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-2d3121e7-cb84-4248-aaa8-8df06eed94b5 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=05cef140-037d-459e-a03d-a6915273f9d4 HTTP/1.1" status: 200 len: 855 time: 0.0459208 Aug 24 03:03:52.118132 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-35cb20b0-afba-4867-b138-c8c80cdaae58 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=a8a02a2d-c194-4f2f-9653-b6e128589efc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0257514 Aug 24 03:03:52.207600 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-05af17f0-3661-49c7-a211-a2b0d63f687a service neutron] 10.222.0.43 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820339 Aug 24 03:03:52.303443 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05dd0df-7c87-499c-b305-3359ed07e480 req-1c044fbb-383a-401f-8e81-bc7cf4de0176 service neutron] 10.222.0.43 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851266 Aug 24 03:03:53.018041 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device da408c70-a5b7-41ab-b17e-9b4b0a3b8efd up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:53.070251 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:53.070639 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:53.102436 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47d9bb8-4cd1-4811-b3eb-05ecd53bc759 req-8031eb8d-e52f-45de-a4e4-4a399e573127 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:53.104621 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d47d9bb8-4cd1-4811-b3eb-05ecd53bc759 req-8031eb8d-e52f-45de-a4e4-4a399e573127 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 944 time: 0.0555766 Aug 24 03:03:53.168705 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d47d9bb8-4cd1-4811-b3eb-05ecd53bc759 req-c9be9ee8-b1d9-4d37-9ecc-4eba1cb872fe tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561476 Aug 24 03:03:54.227502 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-d215a50c-3595-4b79-befb-e67d754bad2f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:54.300106 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7466ee9f-2124-4be9-a81e-9c0b61936460 req-6581f75d-d52e-44e1-8466-cd08b9a7ac8b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:54.301581 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7466ee9f-2124-4be9-a81e-9c0b61936460 req-6581f75d-d52e-44e1-8466-cd08b9a7ac8b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 944 time: 0.0561485 Aug 24 03:03:54.340695 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7466ee9f-2124-4be9-a81e-9c0b61936460 req-3fc902ab-d3a7-4b35-b099-afe933170ac5 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320094 Aug 24 03:03:54.367288 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:55.288357 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:03:55.469820 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ed329e-737d-4e89-94d4-6ecb0c061204 req-522ae7cc-6029-4531-a25b-70fda3dff441 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:55.471678 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-40ed329e-737d-4e89-94d4-6ecb0c061204 req-522ae7cc-6029-4531-a25b-70fda3dff441 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 944 time: 0.0543745 Aug 24 03:03:55.508733 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:55.510700 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-40ed329e-737d-4e89-94d4-6ecb0c061204 req-91b11a59-e551-415b-845c-f4b4725d9a3b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324678 Aug 24 03:03:55.521408 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d', 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc', 'port_id': 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d', 'mac_address': 'fa:16:3e:b1:6c:bc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 382, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '05cef140-037d-459e-a03d-a6915273f9d4', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:03:55.565246 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:55.579397 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:03:55.599094 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:55.602800 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:55.676131 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:55.725831 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:55.956640 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:03:56.628062 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c6111c-d42f-4a5b-bd08-bd27ed94e4b9 req-b9004ad0-0dfe-4a21-8a8f-bb63b0e18960 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:56.629447 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-72c6111c-d42f-4a5b-bd08-bd27ed94e4b9 req-b9004ad0-0dfe-4a21-8a8f-bb63b0e18960 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 945 time: 0.0498586 Aug 24 03:03:56.667786 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-72c6111c-d42f-4a5b-bd08-bd27ed94e4b9 req-6ac64c0e-8097-4efd-8e98-dca7bd1fb566 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323968 Aug 24 03:03:56.978397 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:57.293627 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:03:57.401300 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:03:57.406027 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:03:57.406493 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:57.487609 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:57.511837 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62e2db1f-a628-41d4-bc7a-eed2965da9d4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:03:57.514125 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7855316e-1cb9-4d38-9c01-013c1bc4ec41" -d '{"events": [{"server_uuid": "62e2db1f-a628-41d4-bc7a-eed2965da9d4", "name": "network-vif-plugged", "status": "completed", "tag": "c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:03:57.527146 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:03:57.553014 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:03:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56097c68-8d18-4384-91e7-b2cce4ab498d x-openstack-request-id: req-56097c68-8d18-4384-91e7-b2cce4ab498d {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:03:57.553312 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "62e2db1f-a628-41d4-bc7a-eed2965da9d4", "name": "network-vif-plugged", "status": "completed", "tag": "c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:03:57.553564 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-56097c68-8d18-4384-91e7-b2cce4ab498d {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:03:57.553982 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '62e2db1f-a628-41d4-bc7a-eed2965da9d4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d', 'code': 200} Aug 24 03:03:57.611207 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:03:57.667309 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:03:57.786850 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29a02f09-7405-4442-80c9-1fe23c895482 req-00a92799-fe48-4b27-b3e5-afc6e012535d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:57.788391 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-29a02f09-7405-4442-80c9-1fe23c895482 req-00a92799-fe48-4b27-b3e5-afc6e012535d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 946 time: 0.0541763 Aug 24 03:03:57.849744 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-29a02f09-7405-4442-80c9-1fe23c895482 req-c0149694-79f7-44ef-a203-58781091a57b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0550313 Aug 24 03:03:57.861781 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcbef2bc-fc19-4d8b-8c53-745ea4c0dfb5 req-88365ff3-04ab-4a8d-8c1d-707e20275a7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:57.863225 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fcbef2bc-fc19-4d8b-8c53-745ea4c0dfb5 req-88365ff3-04ab-4a8d-8c1d-707e20275a7e service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 1099 time: 0.0519683 Aug 24 03:03:57.902796 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fcbef2bc-fc19-4d8b-8c53-745ea4c0dfb5 req-e62a9911-4f8e-41cf-a29c-aa575c190fa7 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0297403 Aug 24 03:03:58.977666 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a47fbe1-8061-4ecb-96fc-c25945af06cd req-6c0ba0a9-e041-49e3-8bee-0e9077d1b503 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:03:58.979125 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7a47fbe1-8061-4ecb-96fc-c25945af06cd req-6c0ba0a9-e041-49e3-8bee-0e9077d1b503 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 946 time: 0.0526273 Aug 24 03:03:59.016826 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7a47fbe1-8061-4ecb-96fc-c25945af06cd req-2ff59812-7164-4861-948c-145441d40609 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317943 Aug 24 03:04:00.134371 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a3d53f-7ede-4bce-81db-86e64d1b2117 req-d9061dcd-cd76-410f-a670-4c72cb7fe388 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:00.135867 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-57a3d53f-7ede-4bce-81db-86e64d1b2117 req-d9061dcd-cd76-410f-a670-4c72cb7fe388 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 946 time: 0.0500183 Aug 24 03:04:00.172980 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-57a3d53f-7ede-4bce-81db-86e64d1b2117 req-76b352a8-e5fe-4320-a6f4-d992a97bdf6b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309396 Aug 24 03:04:01.569484 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:04:03.062796 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-fc5f8fe0-c759-46df-8488-09d0af72c3c8 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:03.064244 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-fc5f8fe0-c759-46df-8488-09d0af72c3c8 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/networks?id=a8a02a2d-c194-4f2f-9653-b6e128589efc HTTP/1.1" status: 200 len: 815 time: 0.1030989 Aug 24 03:04:03.083143 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-7e2f143d-8632-4e2f-b785-7de28056b8dc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/quotas/18e124ea63a5483aba6b8f112a4d4b33 HTTP/1.1" status: 200 len: 375 time: 0.0103657 Aug 24 03:04:03.137075 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-6cc7a212-c74f-40fd-b797-aaba680d992e tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0472925 Aug 24 03:04:03.229721 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-e3047ec6-8592-45c5-ba59-162f2dc626c5 service neutron] 10.222.0.30 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852807 Aug 24 03:04:03.319591 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-143426ef-90fd-4045-8cdd-5953327e72b2 service neutron] 10.222.0.30 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829515 Aug 24 03:04:03.569068 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e1e4c2b7-815a-48e9-9a05-c4816660a2a8 req-9470d2bf-7fb5-4e81-a891-b701ae295e2e tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 210 time: 0.0264504 Aug 24 03:04:04.665070 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7764892f-42a3-4a2c-b905-6647c0374ebd req-7620026e-2055-480d-903d-38b9814e992d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 210 time: 0.0275764 Aug 24 03:04:05.679297 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-fd6df1e4-5fd7-4aad-91f3-a976a8fd29e0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:05.680759 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-fd6df1e4-5fd7-4aad-91f3-a976a8fd29e0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "GET /v2.0/networks?id=a8a02a2d-c194-4f2f-9653-b6e128589efc HTTP/1.1" status: 200 len: 815 time: 0.1024978 Aug 24 03:04:05.697302 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Request body: {'port': {'device_id': 'fdec14ec-5b1c-4b55-8e67-d81b5c72d73d', 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc', 'admin_state_up': True, 'tenant_id': '18e124ea63a5483aba6b8f112a4d4b33'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:05.765165 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-778f974b-e739-4341-8cf0-a5cc0ca2e8ea req-f96329a5-9397-472c-bae0-81b2a3d324b3 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 210 time: 0.0274258 Aug 24 03:04:05.903859 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Made reservation on behalf of 18e124ea63a5483aba6b8f112a4d4b33 for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:04:05.907350 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:06.039651 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Allocated IP 172.20.0.6 (a8a02a2d-c194-4f2f-9653-b6e128589efc/05cef140-037d-459e-a03d-a6915273f9d4/c81e7d9c-7d83-461b-928d-29a453007685) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:04:06.436340 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:06.549930 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:06.563041 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['450b43c8-80f4-420a-a8ae-14a79c1f2644', 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:04:06.593739 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Network a8a02a2d-c194-4f2f-9653-b6e128589efc is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:04:06.596808 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:04:06.600644 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:04:06.608968 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Pushing event updated for resources: {'Port': ['ID=c81e7d9c-7d83-461b-928d-29a453007685,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:06.654620 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:06.655229 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:06.725030 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b252cc49-12a1-4060-9602-87708fdaf060 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0323811 Aug 24 03:04:06.745083 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Request body: {'port': {'device_id': 'fdec14ec-5b1c-4b55-8e67-d81b5c72d73d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:06.800691 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:06.953503 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e228730d-1544-4d7a-886b-737e322f2218 req-7fb8b6d9-2ad2-49dc-957f-78884cd7dea4 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:06.954969 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e228730d-1544-4d7a-886b-737e322f2218 req-7fb8b6d9-2ad2-49dc-957f-78884cd7dea4 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 931 time: 0.1232071 Aug 24 03:04:07.038920 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e228730d-1544-4d7a-886b-737e322f2218 req-aab33db7-9ae7-45ae-9e7e-152468b24641 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0774016 Aug 24 03:04:07.132287 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c81e7d9c-7d83-461b-928d-29a453007685 {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:04:07.139740 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:07.151117 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Transition to ACTIVE for port object c81e7d9c-7d83-461b-928d-29a453007685 will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:04:07.223756 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:07.290839 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Pushing event updated for resources: {'Port': ['ID=c81e7d9c-7d83-461b-928d-29a453007685,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:07.338195 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Attempting to bind port c81e7d9c-7d83-461b-928d-29a453007685 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:04:07.338525 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Attempting to bind port c81e7d9c-7d83-461b-928d-29a453007685 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:04:07.338853 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Attempting to bind port c81e7d9c-7d83-461b-928d-29a453007685 on network a8a02a2d-c194-4f2f-9653-b6e128589efc {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:04:07.342968 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Port c81e7d9c-7d83-461b-928d-29a453007685 on network a8a02a2d-c194-4f2f-9653-b6e128589efc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:04:07.343287 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Attempting to bind port c81e7d9c-7d83-461b-928d-29a453007685 on network a8a02a2d-c194-4f2f-9653-b6e128589efc {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:04:07.347981 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 3, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:04:07.348316 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Checking segment: {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:04:07.348688 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Bound using segment: {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:04:07.349102 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Bound port: c81e7d9c-7d83-461b-928d-29a453007685, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:04:07.349450 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:07.414316 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] For port c81e7d9c-7d83-461b-928d-29a453007685, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:04:07.417148 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] For port c81e7d9c-7d83-461b-928d-29a453007685, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c81e7d9c-7d83-461b-928d-29a453007685,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:04:07.509532 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:07.543329 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:07.543936 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:07.545325 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] 10.222.0.43 "PUT /v2.0/ports/c81e7d9c-7d83-461b-928d-29a453007685 HTTP/1.1" status: 200 len: 1093 time: 0.8046319 Aug 24 03:04:07.545802 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fdec14ec-5b1c-4b55-8e67-d81b5c72d73d', 'tag': 'c81e7d9c-7d83-461b-928d-29a453007685'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:07.548022 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a1908b9e-dfe1-4392-b7b9-eef7d4f02885" -d '{"events": [{"name": "network-changed", "server_uuid": "fdec14ec-5b1c-4b55-8e67-d81b5c72d73d", "tag": "c81e7d9c-7d83-461b-928d-29a453007685"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:07.572600 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93561698-bc41-444e-bea4-084f1ae30af4 service neutron] Pushing event updated for resources: {'Port': ['ID=c81e7d9c-7d83-461b-928d-29a453007685,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:07.587701 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0b52c75-b7db-4a84-bd11-3a778aaccf0e x-openstack-request-id: req-a0b52c75-b7db-4a84-bd11-3a778aaccf0e {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:07.588010 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fdec14ec-5b1c-4b55-8e67-d81b5c72d73d", "tag": "c81e7d9c-7d83-461b-928d-29a453007685", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:07.588209 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-a0b52c75-b7db-4a84-bd11-3a778aaccf0e {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:07.588609 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fdec14ec-5b1c-4b55-8e67-d81b5c72d73d', 'tag': 'c81e7d9c-7d83-461b-928d-29a453007685', 'status': 'completed', 'code': 200} Aug 24 03:04:07.666859 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1908b9e-dfe1-4392-b7b9-eef7d4f02885 req-000b57c0-6419-46f2-9daa-fc1a3eed83b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:07.668361 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a1908b9e-dfe1-4392-b7b9-eef7d4f02885 req-000b57c0-6419-46f2-9daa-fc1a3eed83b3 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 1096 time: 0.0420203 Aug 24 03:04:07.782337 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1908b9e-dfe1-4392-b7b9-eef7d4f02885 req-5481b74c-fc11-420c-852c-6a6b15e3cbb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:07.783809 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a1908b9e-dfe1-4392-b7b9-eef7d4f02885 req-5481b74c-fc11-420c-852c-6a6b15e3cbb5 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0912602 Aug 24 03:04:07.883825 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1908b9e-dfe1-4392-b7b9-eef7d4f02885 req-e4288be0-08f3-48e2-a642-e2afb288b447 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:07.885266 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a1908b9e-dfe1-4392-b7b9-eef7d4f02885 req-e4288be0-08f3-48e2-a642-e2afb288b447 service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0918188 Aug 24 03:04:07.974478 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-70a38a89-776d-4112-b631-b5ee99806362 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:07.975987 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-70a38a89-776d-4112-b631-b5ee99806362 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 1096 time: 0.0426736 Aug 24 03:04:08.022708 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-d7033ef3-8663-461f-a73a-ced950ee3c47 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c81e7d9c-7d83-461b-928d-29a453007685 HTTP/1.1" status: 200 len: 217 time: 0.0367932 Aug 24 03:04:08.072161 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-966c1a3f-1d83-4aeb-84c8-e93bfc85be0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:08.073740 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-966c1a3f-1d83-4aeb-84c8-e93bfc85be0f service neutron] 10.222.0.43 "GET /v2.0/subnets?id=05cef140-037d-459e-a03d-a6915273f9d4 HTTP/1.1" status: 200 len: 855 time: 0.0437608 Aug 24 03:04:08.106968 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-b93511ea-6b7c-430a-a1a8-c504e85a5fcb service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=a8a02a2d-c194-4f2f-9653-b6e128589efc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0253289 Aug 24 03:04:08.205328 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-070a4897-7405-4611-8cfc-b6f9269cdf04 req-c234e556-be07-4db6-97f1-3879b6201c10 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:08.206792 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-070a4897-7405-4611-8cfc-b6f9269cdf04 req-c234e556-be07-4db6-97f1-3879b6201c10 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 943 time: 0.0989943 Aug 24 03:04:08.255975 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-fec9d36b-61b6-43fe-b0a9-744fe94e4b59 service neutron] 10.222.0.43 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1228452 Aug 24 03:04:08.263721 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-070a4897-7405-4611-8cfc-b6f9269cdf04 req-258aa348-3758-4d7a-b4b5-e2578ed134ff tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504303 Aug 24 03:04:08.352764 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6b3bda7-b902-4766-9e37-cce55ae39cb7 req-73ecc8f4-e198-44bc-aaea-05bb123100cb service neutron] 10.222.0.43 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847735 Aug 24 03:04:08.570387 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:09.378228 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-febd3313-2a2d-4a6d-8801-d9ee00e578fc req-73b52290-1dbb-4116-8fae-cb52c1136d52 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:09.379692 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-febd3313-2a2d-4a6d-8801-d9ee00e578fc req-73b52290-1dbb-4116-8fae-cb52c1136d52 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 943 time: 0.0470679 Aug 24 03:04:09.416165 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-febd3313-2a2d-4a6d-8801-d9ee00e578fc req-c316730c-1b6d-4514-a6d5-052ae6c2da69 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0299776 Aug 24 03:04:10.530048 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d506c8d6-1f83-46ae-902a-d4f5bd3b0718 req-4971ec64-deeb-4cec-813e-99f29248ceb4 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:10.531505 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d506c8d6-1f83-46ae-902a-d4f5bd3b0718 req-4971ec64-deeb-4cec-813e-99f29248ceb4 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 943 time: 0.0494876 Aug 24 03:04:10.569290 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d506c8d6-1f83-46ae-902a-d4f5bd3b0718 req-9eb2cfd9-ac88-4808-9ea4-7b3d6f4a9c0c tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318916 Aug 24 03:04:11.240733 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-7374165c-4cdb-4e54-93a1-57a8dfc2ee62 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-433000894&fields=id&tenant_id=8bca2ab0549a4f099c2421571c26f61b HTTP/1.1" status: 200 len: 267 time: 0.0317945 Aug 24 03:04:11.346962 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-5ac7c46c-0727-4050-ab19-b7937e97e5ca tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:11.348405 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-5ac7c46c-0727-4050-ab19-b7937e97e5ca tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/networks?id=866d4604-551e-4da3-b89c-967338dbafff HTTP/1.1" status: 200 len: 809 time: 0.1007941 Aug 24 03:04:11.362915 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-cfd95a3a-4f28-47ce-8549-10862626b094 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/quotas/8bca2ab0549a4f099c2421571c26f61b HTTP/1.1" status: 200 len: 375 time: 0.0086691 Aug 24 03:04:11.383123 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device c81e7d9c-7d83-461b-928d-29a453007685 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:04:11.414459 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-2cda3b62-de66-4fb2-b494-41e3df55184f tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=8bca2ab0549a4f099c2421571c26f61b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0453265 Aug 24 03:04:11.474922 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port c81e7d9c-7d83-461b-928d-29a453007685, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c81e7d9c-7d83-461b-928d-29a453007685,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:11.485371 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': 'c81e7d9c-7d83-461b-928d-29a453007685', 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc', 'port_id': 'c81e7d9c-7d83-461b-928d-29a453007685', 'mac_address': 'fa:16:3e:4a:2e:52', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 382, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '05cef140-037d-459e-a03d-a6915273f9d4', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:04:11.512211 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-7a00ab6d-1529-4c3c-b8fb-9d13018a5cf3 service neutron] 10.222.0.30 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867581 Aug 24 03:04:11.526671 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:11.538905 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c81e7d9c-7d83-461b-928d-29a453007685 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:04:11.557755 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port c81e7d9c-7d83-461b-928d-29a453007685, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c81e7d9c-7d83-461b-928d-29a453007685,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:11.608862 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-4f5f6148-dd43-45e9-bd89-74585e377bed service neutron] 10.222.0.30 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0904500 Aug 24 03:04:11.619151 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:11.670340 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=c81e7d9c-7d83-461b-928d-29a453007685,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:11.677970 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:11.678328 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:11.678666 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:11.679145 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:11.680424 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:11.680835 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:11.681168 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:11.681492 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:11.681853 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:11.682173 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:11.682561 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:11.682887 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:11.692790 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6703992e-3971-4658-8570-33fedc4e4788 req-6e9c5930-e3dc-4d16-baae-cd347f0a86c6 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:11.694492 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6703992e-3971-4658-8570-33fedc4e4788 req-6e9c5930-e3dc-4d16-baae-cd347f0a86c6 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 944 time: 0.0528014 Aug 24 03:04:11.732818 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6703992e-3971-4658-8570-33fedc4e4788 req-489f51fb-e3ca-4fa2-8c27-5c665ec7729d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323358 Aug 24 03:04:11.917524 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['c81e7d9c-7d83-461b-928d-29a453007685'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:04:12.265846 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3715e8ea-cc18-4763-bff5-64d75dd0c275 req-abab9ab1-fd7f-4c19-9555-77fc2690c16d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 210 time: 0.0304818 Aug 24 03:04:12.850698 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6923beee-6587-471f-a016-c62ffd6bebce req-cc444218-6f05-4d30-87b0-fbbef0adac6e tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:12.852890 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6923beee-6587-471f-a016-c62ffd6bebce req-cc444218-6f05-4d30-87b0-fbbef0adac6e tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 944 time: 0.0513203 Aug 24 03:04:12.895209 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6923beee-6587-471f-a016-c62ffd6bebce req-73abb615-242e-4c0d-9cfb-6aa1ad6468d2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0362179 Aug 24 03:04:13.359802 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-194a52fb-a1a6-4bb0-8a28-c2044f493cab req-ea3db852-bf50-4bc1-b5d8-f43a14752126 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 210 time: 0.0258164 Aug 24 03:04:13.386299 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device c81e7d9c-7d83-461b-928d-29a453007685 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:04:13.480636 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port c81e7d9c-7d83-461b-928d-29a453007685 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:04:13.484529 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port c81e7d9c-7d83-461b-928d-29a453007685 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:04:13.484906 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:13.561464 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:13.583273 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdec14ec-5b1c-4b55-8e67-d81b5c72d73d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c81e7d9c-7d83-461b-928d-29a453007685'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:13.586081 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f2798743-2698-41d3-8f05-db41bfdd3ca6" -d '{"events": [{"server_uuid": "fdec14ec-5b1c-4b55-8e67-d81b5c72d73d", "name": "network-vif-plugged", "status": "completed", "tag": "c81e7d9c-7d83-461b-928d-29a453007685"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:13.598801 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port c81e7d9c-7d83-461b-928d-29a453007685, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c81e7d9c-7d83-461b-928d-29a453007685,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:13.624267 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64173e84-f6e2-40c2-98d1-73c55caeb262 x-openstack-request-id: req-64173e84-f6e2-40c2-98d1-73c55caeb262 {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:13.624582 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdec14ec-5b1c-4b55-8e67-d81b5c72d73d", "name": "network-vif-plugged", "status": "completed", "tag": "c81e7d9c-7d83-461b-928d-29a453007685", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:13.624810 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-64173e84-f6e2-40c2-98d1-73c55caeb262 {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:13.625192 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdec14ec-5b1c-4b55-8e67-d81b5c72d73d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c81e7d9c-7d83-461b-928d-29a453007685', 'code': 200} Aug 24 03:04:13.673254 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:13.727036 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=c81e7d9c-7d83-461b-928d-29a453007685,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:13.964800 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d37c1b1b-5ae4-426c-9697-ed2d87ab8d5c req-d952f700-de7c-4f5c-8627-dcc85e42af74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:13.966329 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d37c1b1b-5ae4-426c-9697-ed2d87ab8d5c req-d952f700-de7c-4f5c-8627-dcc85e42af74 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 1098 time: 0.0510721 Aug 24 03:04:14.031409 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d37c1b1b-5ae4-426c-9697-ed2d87ab8d5c req-1ce342cf-6891-46bc-8f19-2c6acac064b0 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531294 Aug 24 03:04:14.039583 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b48886-e9af-48ec-a466-9b9055434507 req-f9ebf79e-bc21-473b-979b-94e2f06f3a0b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:14.040953 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a4b48886-e9af-48ec-a466-9b9055434507 req-f9ebf79e-bc21-473b-979b-94e2f06f3a0b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 945 time: 0.0724626 Aug 24 03:04:14.081609 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a4b48886-e9af-48ec-a466-9b9055434507 req-ade7a548-1280-4172-891b-744466d44518 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344994 Aug 24 03:04:14.452576 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-47903f1c-3ebd-4d2b-8015-a89aada8c0a1 req-efb62289-5926-4407-ab22-02cc4d3b7b69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 210 time: 0.0252841 Aug 24 03:04:14.842899 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-929ad673-0be4-4232-893f-25ac8da025ac tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:14.844374 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-929ad673-0be4-4232-893f-25ac8da025ac tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.43 "GET /v2.0/networks?id=866d4604-551e-4da3-b89c-967338dbafff HTTP/1.1" status: 200 len: 809 time: 0.1041846 Aug 24 03:04:14.899956 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-33ecf438-d5c3-4c49-b7bd-3a42061cd60b tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.43 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8bca2ab0549a4f099c2421571c26f61b HTTP/1.1" status: 200 len: 379 time: 0.0337939 Aug 24 03:04:14.912272 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Request body: {'port': {'device_id': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'admin_state_up': True, 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'security_groups': ['e415ccde-c5f3-41fa-a088-107816b2da10']}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:15.164119 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Made reservation on behalf of 8bca2ab0549a4f099c2421571c26f61b for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:04:15.167844 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:15.252847 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1574a44d-420e-4a7d-a82f-99ace120a78b req-cca73da7-44f7-4ca1-8260-64ee00e6aba7 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:15.254398 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1574a44d-420e-4a7d-a82f-99ace120a78b req-cca73da7-44f7-4ca1-8260-64ee00e6aba7 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 945 time: 0.1049185 Aug 24 03:04:15.335874 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1574a44d-420e-4a7d-a82f-99ace120a78b req-31e0a123-80e8-4259-9da0-ec077cedc83a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723748 Aug 24 03:04:15.349000 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Allocated IP 172.20.0.7 (866d4604-551e-4da3-b89c-967338dbafff/4ffb6451-69cb-476e-bc2e-5b6165a067b1/8069cbc1-7d07-44d4-b500-7a5a4c751d09) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:04:15.486716 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:15.501482 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Transition to ACTIVE for port object 8069cbc1-7d07-44d4-b500-7a5a4c751d09 will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:04:15.548793 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4d94424f-0351-4d79-bb6b-b49374ecb32c req-0ee33076-3ce6-4b01-803b-4a3347c55a20 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 210 time: 0.0270426 Aug 24 03:04:15.616324 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:15.662770 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Network 866d4604-551e-4da3-b89c-967338dbafff is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:04:15.666234 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:04:15.669889 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:04:15.695743 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event updated for resources: {'Port': ['ID=8069cbc1-7d07-44d4-b500-7a5a4c751d09,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:15.732598 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:15.733141 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:15.824828 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-ba314030-562e-4f73-a271-153015c4852c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9160502 Aug 24 03:04:15.845187 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Request body: {'port': {'device_id': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:15.898544 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:15.932233 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-c4432f27-6b24-4865-8686-f31008ea2517 None None] Provisioning for port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:04:15.936656 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-c4432f27-6b24-4865-8686-f31008ea2517 None None] Provisioning complete for port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:04:15.937141 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c4432f27-6b24-4865-8686-f31008ea2517 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:15.970322 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-c4432f27-6b24-4865-8686-f31008ea2517 None None] Port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:04:16.164409 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8069cbc1-7d07-44d4-b500-7a5a4c751d09 {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:04:16.171984 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:16.183653 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Transition to ACTIVE for port object 8069cbc1-7d07-44d4-b500-7a5a4c751d09 will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:04:16.332122 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:16.403579 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Pushing event updated for resources: {'Port': ['ID=8069cbc1-7d07-44d4-b500-7a5a4c751d09,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:16.488597 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Attempting to bind port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:04:16.488928 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Attempting to bind port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:04:16.489252 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Attempting to bind port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 on network 866d4604-551e-4da3-b89c-967338dbafff {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:04:16.502336 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4e83a08-bcff-4f7a-a338-d700c319e9e2 req-8f404c52-c956-4a73-90c3-83b4cb68f9bf tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:16.503843 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d4e83a08-bcff-4f7a-a338-d700c319e9e2 req-8f404c52-c956-4a73-90c3-83b4cb68f9bf tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 945 time: 0.0799172 Aug 24 03:04:16.504941 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 on network 866d4604-551e-4da3-b89c-967338dbafff not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:04:16.505267 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Attempting to bind port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 on network 866d4604-551e-4da3-b89c-967338dbafff {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:04:16.513883 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 4, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:04:16.514099 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Checking segment: {'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:04:16.514482 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Bound using segment: {'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:04:16.514969 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Bound port: 8069cbc1-7d07-44d4-b500-7a5a4c751d09, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '866d4604-551e-4da3-b89c-967338dbafff'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:04:16.515275 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:16.576985 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d4e83a08-bcff-4f7a-a338-d700c319e9e2 req-0fc525d0-cb44-46aa-908c-4471d27c8eea tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650301 Aug 24 03:04:16.605802 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] For port 8069cbc1-7d07-44d4-b500-7a5a4c751d09, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:04:16.609725 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] For port 8069cbc1-7d07-44d4-b500-7a5a4c751d09, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:04:16.674922 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7240d760-3ee6-410c-b709-90885a8af087 req-ca16bc5c-2204-46a0-accf-dee3af39ca2f tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:16.674922 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7240d760-3ee6-410c-b709-90885a8af087 req-ca16bc5c-2204-46a0-accf-dee3af39ca2f tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0493515 Aug 24 03:04:16.692476 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:16.718691 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7240d760-3ee6-410c-b709-90885a8af087 req-cea4ed23-5c4d-4960-9327-1df7a0bf57b6 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403419 Aug 24 03:04:16.728344 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:16.728975 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:16.740223 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] 10.222.0.43 "PUT /v2.0/ports/8069cbc1-7d07-44d4-b500-7a5a4c751d09 HTTP/1.1" status: 200 len: 1093 time: 0.8895295 Aug 24 03:04:16.740223 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:16.740223 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d233d1e0-5a99-4e55-8db2-201362989d1d" -d '{"events": [{"name": "network-changed", "server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:16.764200 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0e51454-ee3b-42c2-bbf6-40d20a405c9f service neutron] Pushing event updated for resources: {'Port': ['ID=8069cbc1-7d07-44d4-b500-7a5a4c751d09,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:16.779401 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de68210e-6799-4e3c-9c45-451a81e55cd2 x-openstack-request-id: req-de68210e-6799-4e3c-9c45-451a81e55cd2 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:16.779901 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:16.780231 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-de68210e-6799-4e3c-9c45-451a81e55cd2 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:16.780696 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'status': 'completed', 'code': 200} Aug 24 03:04:16.851560 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d233d1e0-5a99-4e55-8db2-201362989d1d req-375d9f26-670b-4468-b4a5-2df0cdaf2fd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:16.853482 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d233d1e0-5a99-4e55-8db2-201362989d1d req-375d9f26-670b-4468-b4a5-2df0cdaf2fd7 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=8bca2ab0549a4f099c2421571c26f61b&device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 1096 time: 0.0493755 Aug 24 03:04:16.964368 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d233d1e0-5a99-4e55-8db2-201362989d1d req-934c8d8b-4282-413b-ab5a-5cfc59fb22c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:16.966165 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d233d1e0-5a99-4e55-8db2-201362989d1d req-934c8d8b-4282-413b-ab5a-5cfc59fb22c2 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=8bca2ab0549a4f099c2421571c26f61b&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0943613 Aug 24 03:04:17.065229 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d233d1e0-5a99-4e55-8db2-201362989d1d req-5e53b2be-9b4f-481e-b182-0b666e8a970a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:17.066715 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d233d1e0-5a99-4e55-8db2-201362989d1d req-5e53b2be-9b4f-481e-b182-0b666e8a970a service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0912435 Aug 24 03:04:17.157731 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-3d3ec790-8738-4b9a-996e-7d2aa1444696 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:17.159399 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-3d3ec790-8738-4b9a-996e-7d2aa1444696 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=8bca2ab0549a4f099c2421571c26f61b&device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 1096 time: 0.0463660 Aug 24 03:04:17.205326 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-2a199a39-2eff-4680-ad9b-33fc86e04c8a service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09 HTTP/1.1" status: 200 len: 217 time: 0.0350842 Aug 24 03:04:17.261090 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-96892df4-78e5-4bec-aa4e-edf9c9bea0e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:17.262705 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-96892df4-78e5-4bec-aa4e-edf9c9bea0e8 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4ffb6451-69cb-476e-bc2e-5b6165a067b1 HTTP/1.1" status: 200 len: 848 time: 0.0481272 Aug 24 03:04:17.314048 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-5338f93c-b4fa-416b-a13a-555143b27f63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:17.315504 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-5338f93c-b4fa-416b-a13a-555143b27f63 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=866d4604-551e-4da3-b89c-967338dbafff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0442839 Aug 24 03:04:17.411451 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-80a89cef-fada-4f2f-8a35-33178bcb0b49 service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861409 Aug 24 03:04:17.512871 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8a2eb57e-b8cc-4cc9-901c-342e9b2a7cad req-a00d6592-8be3-437d-b145-2f4d623ff9ad service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861323 Aug 24 03:04:17.833823 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65331281-8940-44e7-b4a0-de2e852dd2db req-92bbed0e-4e6a-4b8f-9be7-7dd2cc18f69a tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:17.835241 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-65331281-8940-44e7-b4a0-de2e852dd2db req-92bbed0e-4e6a-4b8f-9be7-7dd2cc18f69a tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0482450 Aug 24 03:04:17.875444 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-65331281-8940-44e7-b4a0-de2e852dd2db req-c4443159-16bc-4965-89e0-75aedd427c52 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0335093 Aug 24 03:04:18.987422 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd5e65b-5af5-4680-a7fa-cdebc65affab req-940b55b0-782d-4049-bf6d-1dac2129bc74 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:18.988887 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0cd5e65b-5af5-4680-a7fa-cdebc65affab req-940b55b0-782d-4049-bf6d-1dac2129bc74 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0483196 Aug 24 03:04:19.025932 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0cd5e65b-5af5-4680-a7fa-cdebc65affab req-54253d1d-43fd-4236-8b43-b2e1fbeda689 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0308335 Aug 24 03:04:20.173779 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66aedfcd-4565-4b1d-bfd7-d4f3069845e9 req-b5133282-aac2-466c-a032-d0390f332a95 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:20.175264 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-66aedfcd-4565-4b1d-bfd7-d4f3069845e9 req-b5133282-aac2-466c-a032-d0390f332a95 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0675149 Aug 24 03:04:20.218476 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-66aedfcd-4565-4b1d-bfd7-d4f3069845e9 req-7605be40-f848-474a-95c3-78f7b874aa08 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0353081 Aug 24 03:04:21.340762 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f722fae1-dcb5-438e-b447-31d839fc34f1 req-8e0c620c-4fa6-43b2-96a7-f4d57fe27007 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:21.342275 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f722fae1-dcb5-438e-b447-31d839fc34f1 req-8e0c620c-4fa6-43b2-96a7-f4d57fe27007 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0498223 Aug 24 03:04:21.379072 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f722fae1-dcb5-438e-b447-31d839fc34f1 req-c2f31067-2162-4130-8348-b51b9571fff0 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309007 Aug 24 03:04:21.389610 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-d3f146ad-50d4-49f1-bd74-f48c4268b2b6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:22.489831 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be889d83-7762-4dcc-b0c9-d3bf97ed822c req-d821d3f7-6285-486c-963a-e4b5bc943a3c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:22.491287 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-be889d83-7762-4dcc-b0c9-d3bf97ed822c req-d821d3f7-6285-486c-963a-e4b5bc943a3c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0479662 Aug 24 03:04:22.531657 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-be889d83-7762-4dcc-b0c9-d3bf97ed822c req-85649c3a-b7d4-4a6f-8590-0587bb1a9c2d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0344429 Aug 24 03:04:23.642847 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05d5a9b-3f61-4d89-b07d-0cddf6987d74 req-bfcb2023-1285-48bc-a0ee-0c8e60217ac0 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:23.644105 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05d5a9b-3f61-4d89-b07d-0cddf6987d74 req-bfcb2023-1285-48bc-a0ee-0c8e60217ac0 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0475383 Aug 24 03:04:23.684813 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b05d5a9b-3f61-4d89-b07d-0cddf6987d74 req-c345fa1a-eedd-42ad-a206-b0c915216ac3 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0344892 Aug 24 03:04:23.949073 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4316d9bd-4fe7-4690-b5ee-c27ccc2fbeca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:24.337827 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:24.801105 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a63492a6-780c-4229-8d64-688bdc59b936 req-733f9d88-debb-44f0-a45d-3a0628ca3be4 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:24.802506 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a63492a6-780c-4229-8d64-688bdc59b936 req-733f9d88-debb-44f0-a45d-3a0628ca3be4 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0487578 Aug 24 03:04:24.839204 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a63492a6-780c-4229-8d64-688bdc59b936 req-32bb349b-8c5b-41d5-83cb-c4c86fe28ef7 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306613 Aug 24 03:04:25.496843 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 8069cbc1-7d07-44d4-b500-7a5a4c751d09 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:04:25.586079 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:25.590736 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 8069cbc1-7d07-44d4-b500-7a5a4c751d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:25.600677 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'port_id': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'mac_address': 'fa:16:3e:fe:82:f7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 375, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:04:25.638165 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:25.651720 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8069cbc1-7d07-44d4-b500-7a5a4c751d09 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:04:25.670605 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 8069cbc1-7d07-44d4-b500-7a5a4c751d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:25.769715 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:25.816336 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=8069cbc1-7d07-44d4-b500-7a5a4c751d09,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:25.952227 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53aedea9-0cc4-4d0e-9644-6c8f206859ae req-817429c1-00eb-463c-bc8b-7587ff51c093 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:25.953710 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-53aedea9-0cc4-4d0e-9644-6c8f206859ae req-817429c1-00eb-463c-bc8b-7587ff51c093 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 944 time: 0.0483594 Aug 24 03:04:25.990807 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-53aedea9-0cc4-4d0e-9644-6c8f206859ae req-2cf8810b-721b-44e1-931c-afea19046bbd tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0311944 Aug 24 03:04:26.181356 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['8069cbc1-7d07-44d4-b500-7a5a4c751d09'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:04:26.952435 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:27.201369 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-390e58d9-8e57-4efb-bcf7-f9317057c227 req-1071e92c-dd20-40e6-85a7-98437ab55b84 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:27.202849 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-390e58d9-8e57-4efb-bcf7-f9317057c227 req-1071e92c-dd20-40e6-85a7-98437ab55b84 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 944 time: 0.1467154 Aug 24 03:04:27.248690 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-390e58d9-8e57-4efb-bcf7-f9317057c227 req-5d343102-50ba-4be7-b50a-3e52c219674f tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399108 Aug 24 03:04:27.513688 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 8069cbc1-7d07-44d4-b500-7a5a4c751d09 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:04:27.622978 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:04:27.627001 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:04:27.627386 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:27.704597 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:27.728081 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:27.731401 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f1d6f174-e4f2-4353-b79c-34a9ac0f05ff" -d '{"events": [{"server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "name": "network-vif-plugged", "status": "completed", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:27.743976 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 8069cbc1-7d07-44d4-b500-7a5a4c751d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:27.768194 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-99529c05-8f22-4171-8054-f5905df1eb7f x-openstack-request-id: req-99529c05-8f22-4171-8054-f5905df1eb7f {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:27.768487 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "name": "network-vif-plugged", "status": "completed", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:27.768763 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-99529c05-8f22-4171-8054-f5905df1eb7f {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:27.769171 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'code': 200} Aug 24 03:04:27.846227 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:27.903706 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=8069cbc1-7d07-44d4-b500-7a5a4c751d09,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:28.205071 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bf49915-3704-48dd-b67b-9660a0660ebf req-9e58e0cb-f40c-44b6-9aee-b6da5892357c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:28.206617 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3bf49915-3704-48dd-b67b-9660a0660ebf req-9e58e0cb-f40c-44b6-9aee-b6da5892357c service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 1098 time: 0.0415149 Aug 24 03:04:28.245028 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3bf49915-3704-48dd-b67b-9660a0660ebf req-af9e43c3-6daf-4459-995f-c1c4655b498a service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0280793 Aug 24 03:04:28.367383 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd61461b-987a-4deb-b88e-590237d39243 req-d719cd88-9fc4-43fd-afa4-cb1a150ccb03 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:28.369066 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fd61461b-987a-4deb-b88e-590237d39243 req-d719cd88-9fc4-43fd-afa4-cb1a150ccb03 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0508466 Aug 24 03:04:28.409239 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fd61461b-987a-4deb-b88e-590237d39243 req-cf62658c-0c61-430f-b34c-b2944a14ea6a tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0341384 Aug 24 03:04:28.927767 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a24371a-bb47-4f23-a6d2-134a909e52ab req-e646df84-8bc6-4fc1-aa66-f1744190e6a6 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:28.929270 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3a24371a-bb47-4f23-a6d2-134a909e52ab req-e646df84-8bc6-4fc1-aa66-f1744190e6a6 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0488234 Aug 24 03:04:28.969625 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3a24371a-bb47-4f23-a6d2-134a909e52ab req-b6583e1c-8317-446b-a69d-72c251e6cfeb tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0335603 Aug 24 03:04:29.100674 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ea507d7-e30a-4ef2-bb9c-5364459224eb req-a6c1ae99-fe60-4a92-84f6-2e28b7a88b80 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:29.102117 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5ea507d7-e30a-4ef2-bb9c-5364459224eb req-a6c1ae99-fe60-4a92-84f6-2e28b7a88b80 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 947 time: 0.0474751 Aug 24 03:04:29.140593 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5ea507d7-e30a-4ef2-bb9c-5364459224eb req-958add79-5252-4e26-8096-476d1f5acf00 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0317419 Aug 24 03:04:29.519472 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84d8b5e9-def0-4d49-970c-7aa38d2a7f7c req-0e341425-bbc2-477e-84ae-b199e66befce tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:29.520919 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-84d8b5e9-def0-4d49-970c-7aa38d2a7f7c req-0e341425-bbc2-477e-84ae-b199e66befce tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0470097 Aug 24 03:04:29.562525 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-84d8b5e9-def0-4d49-970c-7aa38d2a7f7c req-d4076128-ac24-4914-873b-a5165ebea9a1 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0349910 Aug 24 03:04:30.086318 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cb9b010-59eb-43ab-be4f-a5f3443c6c9b req-77c4ca25-e4f1-4a52-8173-5576fe56c2fb tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:30.087757 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4cb9b010-59eb-43ab-be4f-a5f3443c6c9b req-77c4ca25-e4f1-4a52-8173-5576fe56c2fb tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0489368 Aug 24 03:04:30.129788 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4cb9b010-59eb-43ab-be4f-a5f3443c6c9b req-48ceafbd-9d69-4bc7-ba04-280310c3612d tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0349805 Aug 24 03:04:30.258150 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beca0648-f9ca-4fc7-a7e1-a83cd0dba88d req-ca016b03-df60-48f2-8b9b-0b3fb4f0936b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:30.259509 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-beca0648-f9ca-4fc7-a7e1-a83cd0dba88d req-ca016b03-df60-48f2-8b9b-0b3fb4f0936b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 947 time: 0.0480928 Aug 24 03:04:30.296492 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-beca0648-f9ca-4fc7-a7e1-a83cd0dba88d req-180a2ee4-3efc-42d5-9adc-ca96a898a0f0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0311046 Aug 24 03:04:30.680911 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020be204-8155-4d16-9e6b-8acbcaf5a366 req-75cc8438-2837-492f-8f64-8dbcb5135137 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:30.682516 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-020be204-8155-4d16-9e6b-8acbcaf5a366 req-75cc8438-2837-492f-8f64-8dbcb5135137 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0533900 Aug 24 03:04:30.712303 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-31094ed8-60c5-48b2-938d-074113b2d8d6 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:30.714312 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-31094ed8-60c5-48b2-938d-074113b2d8d6 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/networks?id=a8a02a2d-c194-4f2f-9653-b6e128589efc HTTP/1.1" status: 200 len: 815 time: 0.1025844 Aug 24 03:04:30.722143 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-020be204-8155-4d16-9e6b-8acbcaf5a366 req-557f83e9-7810-4dee-81f8-c0a8e7c15d2c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0328672 Aug 24 03:04:30.729544 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-de45f4b1-77ac-4842-b7ad-d8ff6b6be1d5 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/quotas/18e124ea63a5483aba6b8f112a4d4b33 HTTP/1.1" status: 200 len: 375 time: 0.0090423 Aug 24 03:04:30.788134 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-446d576f-c4bd-4b85-8e8b-7f4675cd7572 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0517254 Aug 24 03:04:30.838269 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc7c8de6-16c2-458a-b08f-b6c3dbbf8df4 req-814a826d-4f78-47ca-a82b-1f54d2fbf4d6 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:30.839847 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cc7c8de6-16c2-458a-b08f-b6c3dbbf8df4 req-814a826d-4f78-47ca-a82b-1f54d2fbf4d6 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0502064 Aug 24 03:04:30.877275 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cc7c8de6-16c2-458a-b08f-b6c3dbbf8df4 req-6648bb85-1eb1-4719-b1e4-15c401b01837 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313108 Aug 24 03:04:30.898699 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37688) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:30.920603 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-4cc8a959-7ac9-4011-9746-5dc7d3bccdb4 service neutron] 10.222.0.30 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1265984 Aug 24 03:04:30.979779 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f88ba81-65d1-46a1-a2b2-3de42f2af01c tempest-TestShelveInstance-1972829106 tempest-TestShelveInstance-1972829106-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:30.983961 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-3f88ba81-65d1-46a1-a2b2-3de42f2af01c tempest-TestShelveInstance-1972829106 tempest-TestShelveInstance-1972829106-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 1093 time: 0.0816052 Aug 24 03:04:30.984203 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37692) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:30.988689 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Request body: {'floatingip': {'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'port_id': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'fixed_ip_address': '172.20.0.7'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:31.015344 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-2a1b9c05-fd8c-459b-ade4-c80ee648d7cb service neutron] 10.222.0.30 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0885224 Aug 24 03:04:31.083834 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for floatingip, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:31.183238 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:31.266156 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-44d43a11-d79f-4e2b-9825-71f30e4ec1c0 req-05a58d1d-9eb2-4c14-b1bd-39bb5e406cec tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 210 time: 0.0297594 Aug 24 03:04:31.356684 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-35577d2c-d67c-45a2-a5c9-c6d6cc517f34 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:31.358282 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-35577d2c-d67c-45a2-a5c9-c6d6cc517f34 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.43 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 947 time: 0.1365056 Aug 24 03:04:31.365637 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c23a8a7-775b-45cf-94b9-50c601a009d1 req-ba4c0c36-24f0-40a7-b27a-7fda88d9154e tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:31.367032 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7c23a8a7-775b-45cf-94b9-50c601a009d1 req-ba4c0c36-24f0-40a7-b27a-7fda88d9154e tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.1441000 Aug 24 03:04:31.427800 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93b27da5-62cb-45b9-973f-58575bd3272f req-7f027faf-6277-4ed7-aba7-67b6f6d80345 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:31.429488 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-93b27da5-62cb-45b9-973f-58575bd3272f req-7f027faf-6277-4ed7-aba7-67b6f6d80345 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 947 time: 0.0563645 Aug 24 03:04:31.437364 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Allocated IP 172.27.2.112 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/1b32c3bd-bd0a-4c78-92f0-3137d18bd870) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:04:31.469988 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-93b27da5-62cb-45b9-973f-58575bd3272f req-ba334b03-480b-4d44-953b-dbc6df59af0d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0336730 Aug 24 03:04:31.490569 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7c23a8a7-775b-45cf-94b9-50c601a009d1 req-c570116c-5235-4fe4-8dfd-23c51f6fbc46 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1112795 Aug 24 03:04:31.614535 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Deleting port 881a8667-42c4-4263-84c5-a172725c834f {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:04:31.614793 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:31.649493 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-76500b7c-0223-45b8-8de2-1a02da0c9c45 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:31.650972 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-76500b7c-0223-45b8-8de2-1a02da0c9c45 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.43 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.1129870 Aug 24 03:04:31.677888 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:31.810657 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] For port 881a8667-42c4-4263-84c5-a172725c834f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=881a8667-42c4-4263-84c5-a172725c834f,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:31.811043 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:32.133436 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:32.190576 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Deleting port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:04:32.191960 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:32.303637 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:04:32.308769 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event updated for resources: {'Port': ['ID=1b32c3bd-bd0a-4c78-92f0-3137d18bd870,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:32.314757 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:04:32.319998 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:04:32.358954 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-cc82a0f5-e973-42f2-be21-6003d6cc6192 req-9230fefd-8e33-4d78-bb91-1261328a5d32 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 210 time: 0.0262945 Aug 24 03:04:32.428262 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] For port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:32.428545 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:32.477112 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:32.477502 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:32.477853 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.l3_db [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Floating IP ebbc0a41-08cf-4f3e-b20a-e2e59171ca53 disassociated. External IP: 172.27.2.83, port: 881a8667-42c4-4263-84c5-a172725c834f. Aug 24 03:04:32.478197 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Calling delete_port for 881a8667-42c4-4263-84c5-a172725c834f owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:04:32.617588 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b405692-72e6-41e3-bd03-c49d76844536 req-549eea9b-4b89-47a1-b53e-8f47f38a15d5 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:32.619213 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7b405692-72e6-41e3-bd03-c49d76844536 req-549eea9b-4b89-47a1-b53e-8f47f38a15d5 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 946 time: 0.0547121 Aug 24 03:04:32.659460 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7b405692-72e6-41e3-bd03-c49d76844536 req-e69b5da4-0d9b-46e5-9e43-3fa0b180cf3d tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=9efe755d-a2a2-41c1-926c-a4d4a12f8864&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0318120 Aug 24 03:04:32.801453 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f279dea8-97bb-44a8-99b5-c030d815ce7b req-13e57046-f691-41c9-8550-e10a495fb9d6 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:32.802967 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f279dea8-97bb-44a8-99b5-c030d815ce7b req-13e57046-f691-41c9-8550-e10a495fb9d6 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 947 time: 0.2482653 Aug 24 03:04:32.936241 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f279dea8-97bb-44a8-99b5-c030d815ce7b req-3bc37fdd-6b81-4995-bfdd-f645e243b4a7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=a1448037-be52-4652-b9f5-5fdd1b21a769&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1233394 Aug 24 03:04:33.012681 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:33.013074 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:33.013393 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.l3_db [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Floating IP fec6f3c0-dff8-42a4-ac0a-99b41100efe5 disassociated. External IP: 172.27.2.141, port: b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd. Aug 24 03:04:33.013774 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Calling delete_port for b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:04:33.019175 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:33.078538 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event deleted for resources: {'Port': ['ID=881a8667-42c4-4263-84c5-a172725c834f,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:33.334775 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for floatingip, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:33.397317 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Router 0195ba54-f802-48e9-b0df-bdb173e4aa57 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:04:33.406739 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-70033142-c6fd-4750-94bb-fff80269f97b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:33.408316 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-70033142-c6fd-4750-94bb-fff80269f97b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "GET /v2.0/networks?id=a8a02a2d-c194-4f2f-9653-b6e128589efc HTTP/1.1" status: 200 len: 815 time: 0.1144416 Aug 24 03:04:33.431417 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Request body: {'port': {'device_id': '6d327609-1228-4ab7-b533-aaa4697437f3', 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc', 'admin_state_up': True, 'tenant_id': '18e124ea63a5483aba6b8f112a4d4b33'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:33.500649 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1ce97d37-c8bb-454b-9004-6411f1640f8c req-5a0cae55-bbc5-4be0-a056-8460d7b014cf tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 210 time: 0.0632956 Aug 24 03:04:33.525726 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:33.580706 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:33.633442 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event deleted for resources: {'Port': ['ID=b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:33.669251 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Made reservation on behalf of 18e124ea63a5483aba6b8f112a4d4b33 for: {'port': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:04:33.672891 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:33.695840 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:04:33.707300 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f29dbefe-0c37-4161-86b2-8745e39ea0b2 None None] Sync routers for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:04:33.724583 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f29dbefe-0c37-4161-86b2-8745e39ea0b2 None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:04:33.731489 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-f29dbefe-0c37-4161-86b2-8745e39ea0b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:04:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:33.826700 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] No DVR routers for this DVR port 881a8667-42c4-4263-84c5-a172725c834f on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:04:33.829429 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:33.831647 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-38ed2bec-5a03-4b2d-b4b7-0465b6567daa req-ef35510a-6e18-4c31-9ed5-a3d04cbd6fbe tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.43 "DELETE /v2.0/ports/881a8667-42c4-4263-84c5-a172725c834f HTTP/1.1" status: 204 len: 173 time: 2.4619870 Aug 24 03:04:33.855113 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'name': 'network-vif-deleted', 'tag': '881a8667-42c4-4263-84c5-a172725c834f'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:33.857673 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3d29af6f-6afe-4a2c-83c9-0a6f6ccea40c" -d '{"events": [{"server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "name": "network-vif-deleted", "tag": "881a8667-42c4-4263-84c5-a172725c834f"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:33.877753 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7f73e744-487b-49fe-b9c2-81f49081e95f req-188d910c-d5e3-4701-84a6-c541a46298d9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 210 time: 0.1218567 Aug 24 03:04:33.924845 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Allocated IP 172.20.0.13 (a8a02a2d-c194-4f2f-9653-b6e128589efc/05cef140-037d-459e-a03d-a6915273f9d4/714fff03-ce7b-45d9-b398-7272d616dd68) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:04:33.927664 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-f29dbefe-0c37-4161-86b2-8745e39ea0b2 None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:04:34.170853 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:34.209423 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2993d742-c41c-49a7-a4a2-d720a58a0b18 x-openstack-request-id: req-2993d742-c41c-49a7-a4a2-d720a58a0b18 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:34.209750 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f8ce3266-ef38-4982-8a99-6c591fdac0d6", "name": "network-vif-deleted", "tag": "881a8667-42c4-4263-84c5-a172725c834f", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:34.210090 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-2993d742-c41c-49a7-a4a2-d720a58a0b18 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:34.210389 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f8ce3266-ef38-4982-8a99-6c591fdac0d6', 'name': 'network-vif-deleted', 'tag': '881a8667-42c4-4263-84c5-a172725c834f', 'status': 'completed', 'code': 200} Aug 24 03:04:34.228635 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-f29dbefe-0c37-4161-86b2-8745e39ea0b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:49Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:34.256258 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f29dbefe-0c37-4161-86b2-8745e39ea0b2 None None] Checking router: 0195ba54-f802-48e9-b0df-bdb173e4aa57 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:04:34.257354 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fca7f0e2-c6bf-42cd-97a1-58905a1c89ef req-a276e77d-e1f4-489a-951d-165b4b3c172a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=f8ce3266-ef38-4982-8a99-6c591fdac0d6 HTTP/1.1" status: 200 len: 210 time: 0.0576923 Aug 24 03:04:34.266261 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f29dbefe-0c37-4161-86b2-8745e39ea0b2 None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:04:34.268734 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-f29dbefe-0c37-4161-86b2-8745e39ea0b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:04:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:34.286906 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:34.306726 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Router 893a8671-6102-43da-9368-0f66640f4cf7 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:04:34.317889 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['450b43c8-80f4-420a-a8ae-14a79c1f2644', 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d', 'c81e7d9c-7d83-461b-928d-29a453007685'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:04:34.318698 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:34.349739 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Network a8a02a2d-c194-4f2f-9653-b6e128589efc is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:04:34.352761 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:04:34.357350 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:04:34.386322 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Pushing event updated for resources: {'Port': ['ID=714fff03-ce7b-45d9-b398-7272d616dd68,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:34.402199 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:34.402771 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:34.403812 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:34.403812 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:34.403812 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:34.404095 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:34.404362 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:34.404635 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:34.405041 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:34.405395 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:34.405744 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:34.406069 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:04:34.425690 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:34.440022 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:34.441368 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:34.457703 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-f29dbefe-0c37-4161-86b2-8745e39ea0b2 None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:04:34.483001 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:04:34.494376 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecf9413a-1c75-4f3b-be38-261c49c7e2e4 None None] Sync routers for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:04:34.505061 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecf9413a-1c75-4f3b-be38-261c49c7e2e4 None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:04:34.506043 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-ecf9413a-1c75-4f3b-be38-261c49c7e2e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:04:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:34.519021 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-cc2aa039-12b0-4278-8f2a-feb8be954f8a tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0947902 Aug 24 03:04:34.539929 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event updated for resources: {'Port': ['ID=1b32c3bd-bd0a-4c78-92f0-3137d18bd870,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:34.541426 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Request body: {'port': {'device_id': '6d327609-1228-4ab7-b533-aaa4697437f3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:34.560110 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] No DVR routers for this DVR port b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:04:34.564190 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:34.566190 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-260d88e0-c4df-4f0f-9fb8-6e2581ce185b req-df1e705e-ed45-4406-983f-3b8090cb7b95 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.43 "DELETE /v2.0/ports/b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd HTTP/1.1" status: 204 len: 173 time: 2.8861008 Aug 24 03:04:34.567402 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:34.628317 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-ecf9413a-1c75-4f3b-be38-261c49c7e2e4 None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:04:34.714088 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.l3_db [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Floating IP 81fab793-8623-49ae-8bb9-30e9de6c0937 associated. External IP: 172.27.2.112, port: 8069cbc1-7d07-44d4-b500-7a5a4c751d09. Aug 24 03:04:34.753796 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:34.887837 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b19c6f-17a8-47d1-a361-09a6d1d830fc req-74bcec72-d2df-45d2-81b6-612bf3ebde70 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:34.891057 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-71b19c6f-17a8-47d1-a361-09a6d1d830fc req-74bcec72-d2df-45d2-81b6-612bf3ebde70 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 932 time: 0.2118480 Aug 24 03:04:34.942491 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-ecf9413a-1c75-4f3b-be38-261c49c7e2e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:43Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:35.003693 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-71b19c6f-17a8-47d1-a361-09a6d1d830fc req-636d5df6-20df-4a7f-bcf8-5f8a237b6c06 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0963447 Aug 24 03:04:35.016811 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecf9413a-1c75-4f3b-be38-261c49c7e2e4 None None] Checking router: 893a8671-6102-43da-9368-0f66640f4cf7 for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:04:35.037547 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecf9413a-1c75-4f3b-be38-261c49c7e2e4 None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:04:35.037547 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-ecf9413a-1c75-4f3b-be38-261c49c7e2e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:04:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:35.089742 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-06432662-12d8-4dc4-aa20-07d589ec9cd7 req-92b9174e-cfea-466c-b4cf-9d306e715f52 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=d7a111a5-6dc1-4030-adaf-661abcbcea71 HTTP/1.1" status: 200 len: 210 time: 0.0553079 Aug 24 03:04:35.121911 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Router 237f95eb-7035-4674-99ff-35e2f14fc035 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:04:35.170186 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-ecf9413a-1c75-4f3b-be38-261c49c7e2e4 None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:04:35.227306 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-f29dbefe-0c37-4161-86b2-8745e39ea0b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:49Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:35.246860 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 714fff03-ce7b-45d9-b398-7272d616dd68 {{(pid=111275) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:04:35.259793 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f29dbefe-0c37-4161-86b2-8745e39ea0b2 None None] The sync data for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi is: [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:49Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:04:35.270979 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:35.310285 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.provisioning_blocks [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Transition to ACTIVE for port object 714fff03-ce7b-45d9-b398-7272d616dd68 will not be triggered until provisioned by entity L2. {{(pid=111275) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:04:35.321250 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:04:35.338149 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28664062-c35c-40ba-921e-2689556d9d57 None None] Sync routers for ids ['237f95eb-7035-4674-99ff-35e2f14fc035'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:04:35.353506 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28664062-c35c-40ba-921e-2689556d9d57 None None] Routers {'237f95eb-7035-4674-99ff-35e2f14fc035'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:04:35.355657 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-28664062-c35c-40ba-921e-2689556d9d57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:04:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['237f95eb-7035-4674-99ff-35e2f14fc035'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:35.377921 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3484283'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:35.443019 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Pushing event updated for resources: {'Port': ['ID=714fff03-ce7b-45d9-b398-7272d616dd68,revision_number=2']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:35.478403 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:35.523327 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37740) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:35.553398 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:04:35.587582 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.managers [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Attempting to bind port 714fff03-ce7b-45d9-b398-7272d616dd68 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:04:35.588077 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.managers [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Attempting to bind port 714fff03-ce7b-45d9-b398-7272d616dd68 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'}] {{(pid=111275) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:04:35.589908 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Attempting to bind port 714fff03-ce7b-45d9-b398-7272d616dd68 on network a8a02a2d-c194-4f2f-9653-b6e128589efc {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:04:35.596527 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-28664062-c35c-40ba-921e-2689556d9d57 None None] Set router 237f95eb-7035-4674-99ff-35e2f14fc035 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:04:35.598919 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:04:35.603667 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-ca753a9c-14fb-4a4e-a28c-e1061b03b209 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 4.6155648 Aug 24 03:04:35.603813 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-ecf9413a-1c75-4f3b-be38-261c49c7e2e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:43Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:35.605151 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:04:35.605696 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 881a8667-42c4-4263-84c5-a172725c834f no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:04:35.624156 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Port 714fff03-ce7b-45d9-b398-7272d616dd68 on network a8a02a2d-c194-4f2f-9653-b6e128589efc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:04:35.624492 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Attempting to bind port 714fff03-ce7b-45d9-b398-7272d616dd68 on network a8a02a2d-c194-4f2f-9653-b6e128589efc {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:04:35.639144 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 4, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:04:35.639485 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Checking segment: {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:04:35.639874 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Bound using segment: {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'} {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:04:35.640313 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.managers [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Bound port: 714fff03-ce7b-45d9-b398-7272d616dd68, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '265560af-a3e0-4c25-85a0-de528164f111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc'}}] {{(pid=111275) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:04:35.640675 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:35.680970 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecf9413a-1c75-4f3b-be38-261c49c7e2e4 None None] The sync data for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi is: [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:43Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:04:35.682747 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-1ccb9466-9742-4fca-92f7-447bae36540d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:35.686607 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 881a8667-42c4-4263-84c5-a172725c834f {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:04:35.688368 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 881a8667-42c4-4263-84c5-a172725c834f not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:04:35.737673 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c811b8c-076a-429b-a9c4-c60fb80a209c None None] New status for floating IP ebbc0a41-08cf-4f3e-b20a-e2e59171ca53: DOWN {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:04:35.748212 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-1ccb9466-9742-4fca-92f7-447bae36540d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:35.789415 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] For port 714fff03-ce7b-45d9-b398-7272d616dd68, host hv-cinder-80374, cleared binding levels {{(pid=111275) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:04:35.793457 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] For port 714fff03-ce7b-45d9-b398-7272d616dd68, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=714fff03-ce7b-45d9-b398-7272d616dd68,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111275) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:04:35.890299 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3484283'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:35.927490 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:35.928112 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:35.929494 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] 10.222.0.43 "PUT /v2.0/ports/714fff03-ce7b-45d9-b398-7272d616dd68 HTTP/1.1" status: 200 len: 1094 time: 1.3928380 Aug 24 03:04:35.930225 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6d327609-1228-4ab7-b533-aaa4697437f3', 'tag': '714fff03-ce7b-45d9-b398-7272d616dd68'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:35.931621 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-1ccb9466-9742-4fca-92f7-447bae36540d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:35.932227 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b2279e4-66e5-4e67-aa0f-10d82fe304be" -d '{"events": [{"name": "network-changed", "server_uuid": "6d327609-1228-4ab7-b533-aaa4697437f3", "tag": "714fff03-ce7b-45d9-b398-7272d616dd68"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:35.935512 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-1ccb9466-9742-4fca-92f7-447bae36540d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:35.937523 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-1ccb9466-9742-4fca-92f7-447bae36540d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "DELETE /v2.0/security-groups/a1448037-be52-4652-b9f5-5fdd1b21a769 HTTP/1.1" status: 204 len: 168 time: 0.4062052 Aug 24 03:04:35.942433 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37746) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:35.989290 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7df6d30c-3c49-44f9-9f25-d4a818326c92 service neutron] Pushing event updated for resources: {'Port': ['ID=714fff03-ce7b-45d9-b398-7272d616dd68,revision_number=3']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:35.993993 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.api.v2.resource [None req-fcb3d528-8c97-434e-8bfe-e15e21cf5702 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] show failed (client error): The resource could not be found. Aug 24 03:04:35.999957 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-fcb3d528-8c97-434e-8bfe-e15e21cf5702 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups/a1448037-be52-4652-b9f5-5fdd1b21a769 HTTP/1.1" status: 404 len: 347 time: 0.0516937 Aug 24 03:04:35.999957 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ccb9466-9742-4fca-92f7-447bae36540d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1448037-be52-4652-b9f5-5fdd1b21a769,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:36.000541 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e2fb7a04-78cd-4f8d-a336-c3833bf85e64 x-openstack-request-id: req-e2fb7a04-78cd-4f8d-a336-c3833bf85e64 {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:36.000541 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6d327609-1228-4ab7-b533-aaa4697437f3", "tag": "714fff03-ce7b-45d9-b398-7272d616dd68", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:36.000541 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e2fb7a04-78cd-4f8d-a336-c3833bf85e64 {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:36.000541 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6d327609-1228-4ab7-b533-aaa4697437f3', 'tag': '714fff03-ce7b-45d9-b398-7272d616dd68', 'status': 'completed', 'code': 200} Aug 24 03:04:36.000891 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37748) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:36.024329 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-28664062-c35c-40ba-921e-2689556d9d57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:03:38Z', 'revision_number': 4, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': '81fab793-8623-49ae-8bb9-30e9de6c0937', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'floating_ip_address': '172.27.2.112', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'port_id': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 457, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'mac_address': 'fa:16:3e:fe:82:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:04:32Z', 'updated_at': '2021-08-24T03:04:32Z', 'revision_number': 0, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a4f138f6-af08-4d87-a100-5579647b168d', 'name': '', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'mac_address': 'fa:16:3e:c0:7f:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_interface', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:37Z', 'updated_at': '2021-08-24T03:03:43Z', 'revision_number': 5, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'subnets': [{'id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:36.065939 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28664062-c35c-40ba-921e-2689556d9d57 None None] Checking router: 237f95eb-7035-4674-99ff-35e2f14fc035 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:04:36.080127 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28664062-c35c-40ba-921e-2689556d9d57 None None] Routers {'237f95eb-7035-4674-99ff-35e2f14fc035'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:04:36.080951 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-28664062-c35c-40ba-921e-2689556d9d57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:04:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['237f95eb-7035-4674-99ff-35e2f14fc035'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:36.121013 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79daa1c2-f73b-4d8f-8dad-35b8e188701d None None] New status for floating IP fec6f3c0-dff8-42a4-ac0a-99b41100efe5: DOWN {{(pid=111277) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:04:36.194128 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b2bd8bc-3be4-4024-a7f4-617b0c9e3497 req-a17aaf3b-ea0f-4508-9e00-de46a906af2d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:36.198319 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b2279e4-66e5-4e67-aa0f-10d82fe304be req-fe795abf-051d-401d-b224-17eda1383b09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:36.200248 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6b2279e4-66e5-4e67-aa0f-10d82fe304be req-fe795abf-051d-401d-b224-17eda1383b09 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 1097 time: 0.1211376 Aug 24 03:04:36.202047 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1b2bd8bc-3be4-4024-a7f4-617b0c9e3497 req-a17aaf3b-ea0f-4508-9e00-de46a906af2d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 944 time: 0.0681186 Aug 24 03:04:36.217092 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'name': 'network-vif-deleted', 'tag': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd'}, {'name': 'network-changed', 'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:36.219511 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2fb7d7d7-6c7f-4621-a13e-9bdbc9ddabc3" -d '{"events": [{"server_uuid": "d7a111a5-6dc1-4030-adaf-661abcbcea71", "name": "network-vif-deleted", "tag": "b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd"}, {"name": "network-changed", "server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:36.231843 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-0343af12-8358-4d4d-9d98-d3d483537472 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Deleting port 926903b3-b9d8-4678-887c-330d4b85073b {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:04:36.232277 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0343af12-8358-4d4d-9d98-d3d483537472 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:36.257943 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1b2bd8bc-3be4-4024-a7f4-617b0c9e3497 req-144dd782-be99-4e8d-93a2-2f72b1130833 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506232 Aug 24 03:04:36.258472 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37758) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:36.346942 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd69a841-fb2e-4557-8e60-041ad8dc785d x-openstack-request-id: req-fd69a841-fb2e-4557-8e60-041ad8dc785d {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:36.347307 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d7a111a5-6dc1-4030-adaf-661abcbcea71", "name": "network-vif-deleted", "tag": "b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:36.347747 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-fd69a841-fb2e-4557-8e60-041ad8dc785d {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:36.348191 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd7a111a5-6dc1-4030-adaf-661abcbcea71', 'name': 'network-vif-deleted', 'tag': 'b3fc0b47-8a29-4a03-85c3-9a6fca2d1afd', 'status': 'completed', 'code': 200} Aug 24 03:04:36.348515 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'status': 'completed', 'code': 200} Aug 24 03:04:36.362933 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d5059c9d-963b-4646-a3e6-e62c32019f42 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:36.378535 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0343af12-8358-4d4d-9d98-d3d483537472 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:36.378764 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0343af12-8358-4d4d-9d98-d3d483537472 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:36.398920 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-28664062-c35c-40ba-921e-2689556d9d57 None None] Set router 237f95eb-7035-4674-99ff-35e2f14fc035 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:04:36.417903 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d5059c9d-963b-4646-a3e6-e62c32019f42 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:36.440193 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-0343af12-8358-4d4d-9d98-d3d483537472 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Calling delete_port for 926903b3-b9d8-4678-887c-330d4b85073b owned by network:floatingip {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:04:36.461702 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb7d7d7-6c7f-4621-a13e-9bdbc9ddabc3 req-80923280-da6f-4ae0-b480-4cb418a10198 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:36.463629 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2fb7d7d7-6c7f-4621-a13e-9bdbc9ddabc3 req-80923280-da6f-4ae0-b480-4cb418a10198 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=8bca2ab0549a4f099c2421571c26f61b&device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 1098 time: 0.1095791 Aug 24 03:04:36.606492 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b2279e4-66e5-4e67-aa0f-10d82fe304be req-4a13f7e0-0822-47b7-a620-1a00c5f8b5a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:36.609511 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6b2279e4-66e5-4e67-aa0f-10d82fe304be req-4a13f7e0-0822-47b7-a620-1a00c5f8b5a5 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&shared=False HTTP/1.1" status: 200 len: 916 time: 0.3869343 Aug 24 03:04:36.612859 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb7d7d7-6c7f-4621-a13e-9bdbc9ddabc3 req-966259e0-d06b-4910-adf8-61c3cc6dbba6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:36.617479 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2fb7d7d7-6c7f-4621-a13e-9bdbc9ddabc3 req-966259e0-d06b-4910-adf8-61c3cc6dbba6 service neutron] 10.222.0.43 "GET /v2.0/networks?id=866d4604-551e-4da3-b89c-967338dbafff HTTP/1.1" status: 200 len: 910 time: 0.1385205 Aug 24 03:04:36.667381 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d5059c9d-963b-4646-a3e6-e62c32019f42 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:36.670256 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d5059c9d-963b-4646-a3e6-e62c32019f42 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:36.674479 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-d5059c9d-963b-4646-a3e6-e62c32019f42 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "DELETE /v2.0/security-groups/9efe755d-a2a2-41c1-926c-a4d4a12f8864 HTTP/1.1" status: 204 len: 168 time: 0.4111862 Aug 24 03:04:36.676331 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37760) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:36.703649 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.api.v2.resource [None req-2c6931a9-fc2e-4dc3-86ff-670c87f31baf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] show failed (client error): The resource could not be found. Aug 24 03:04:36.712111 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-2c6931a9-fc2e-4dc3-86ff-670c87f31baf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups/9efe755d-a2a2-41c1-926c-a4d4a12f8864 HTTP/1.1" status: 404 len: 347 time: 0.0259860 Aug 24 03:04:36.712111 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5059c9d-963b-4646-a3e6-e62c32019f42 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9efe755d-a2a2-41c1-926c-a4d4a12f8864,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:36.712973 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37762) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:36.717474 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-28664062-c35c-40ba-921e-2689556d9d57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:03:38Z', 'revision_number': 4, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': '81fab793-8623-49ae-8bb9-30e9de6c0937', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'floating_ip_address': '172.27.2.112', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'port_id': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 457, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'mac_address': 'fa:16:3e:fe:82:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:04:32Z', 'updated_at': '2021-08-24T03:04:32Z', 'revision_number': 0, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a4f138f6-af08-4d87-a100-5579647b168d', 'name': '', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'mac_address': 'fa:16:3e:c0:7f:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_interface', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:37Z', 'updated_at': '2021-08-24T03:03:43Z', 'revision_number': 5, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'subnets': [{'id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:36.723771 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2fb7d7d7-6c7f-4621-a13e-9bdbc9ddabc3 req-34d1393c-1107-48df-be3b-64a2dccaa9a1 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09 HTTP/1.1" status: 200 len: 999 time: 0.1000748 Aug 24 03:04:36.757179 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28664062-c35c-40ba-921e-2689556d9d57 None None] The sync data for ids ['237f95eb-7035-4674-99ff-35e2f14fc035'] in dv-cinder-803748-8-iscsi is: [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:03:38Z', 'revision_number': 4, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': '81fab793-8623-49ae-8bb9-30e9de6c0937', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'floating_ip_address': '172.27.2.112', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'port_id': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 457, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'mac_address': 'fa:16:3e:fe:82:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:04:32Z', 'updated_at': '2021-08-24T03:04:32Z', 'revision_number': 0, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a4f138f6-af08-4d87-a100-5579647b168d', 'name': '', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'mac_address': 'fa:16:3e:c0:7f:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_interface', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:37Z', 'updated_at': '2021-08-24T03:03:43Z', 'revision_number': 5, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'subnets': [{'id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:04:36.837654 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b2279e4-66e5-4e67-aa0f-10d82fe304be req-6a64ded9-0072-4b12-8188-b4ec2feca950 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:36.839730 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6b2279e4-66e5-4e67-aa0f-10d82fe304be req-6a64ded9-0072-4b12-8188-b4ec2feca950 service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1957712 Aug 24 03:04:36.863782 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb7d7d7-6c7f-4621-a13e-9bdbc9ddabc3 req-08d81999-4a0e-469e-b201-e956f9a59bf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:36.870105 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2fb7d7d7-6c7f-4621-a13e-9bdbc9ddabc3 req-08d81999-4a0e-469e-b201-e956f9a59bf4 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4ffb6451-69cb-476e-bc2e-5b6165a067b1 HTTP/1.1" status: 200 len: 848 time: 0.1114118 Aug 24 03:04:36.922518 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-10d8e95a-2648-455c-aa9f-47d8aae2e012 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Deleting port 5a8c0db8-5ba3-46f9-83b2-1e4c5b5e6238 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:04:36.923016 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-10d8e95a-2648-455c-aa9f-47d8aae2e012 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:36.925118 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-da321438-4527-4867-8273-5d8258ca09ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:36.926679 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-da321438-4527-4867-8273-5d8258ca09ef service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 1097 time: 0.0430179 Aug 24 03:04:36.927609 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb7d7d7-6c7f-4621-a13e-9bdbc9ddabc3 req-96363000-1945-4aef-98c4-8f76fbf793ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:36.929119 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2fb7d7d7-6c7f-4621-a13e-9bdbc9ddabc3 req-96363000-1945-4aef-98c4-8f76fbf793ab service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=866d4604-551e-4da3-b89c-967338dbafff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0554719 Aug 24 03:04:36.980906 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-8c67e9e7-0319-4dd9-a8db-0933dfb91912 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=714fff03-ce7b-45d9-b398-7272d616dd68 HTTP/1.1" status: 200 len: 217 time: 0.0381892 Aug 24 03:04:36.984747 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c6cc6d8-7a8d-4c1b-b0b9-5455390d0462 None None] New status for floating IP 81fab793-8623-49ae-8bb9-30e9de6c0937: ACTIVE {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:04:37.068133 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-10d8e95a-2648-455c-aa9f-47d8aae2e012 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:37.068368 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-10d8e95a-2648-455c-aa9f-47d8aae2e012 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:37.090227 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-10d8e95a-2648-455c-aa9f-47d8aae2e012 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Calling delete_port for 5a8c0db8-5ba3-46f9-83b2-1e4c5b5e6238 owned by network:floatingip {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:04:37.098335 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2fb7d7d7-6c7f-4621-a13e-9bdbc9ddabc3 req-5e72dcc3-9a1f-4d36-863e-90a816eb5f53 service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1292448 Aug 24 03:04:37.241064 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0343af12-8358-4d4d-9d98-d3d483537472 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:37.264898 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2fb7d7d7-6c7f-4621-a13e-9bdbc9ddabc3 req-b952736b-53ba-4f55-8d27-791f11f860c4 service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1210093 Aug 24 03:04:37.270321 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0343af12-8358-4d4d-9d98-d3d483537472 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event deleted for resources: {'Port': ['ID=926903b3-b9d8-4678-887c-330d4b85073b,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:37.309658 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-0bda39bf-f011-4c23-8e87-a7be443e636f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:37.312482 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-0bda39bf-f011-4c23-8e87-a7be443e636f service neutron] 10.222.0.43 "GET /v2.0/subnets?id=05cef140-037d-459e-a03d-a6915273f9d4 HTTP/1.1" status: 200 len: 855 time: 0.3170316 Aug 24 03:04:37.365241 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-08abbc1b-bcc9-4e1f-b84e-a121071bc719 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=a8a02a2d-c194-4f2f-9653-b6e128589efc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0319901 Aug 24 03:04:37.381717 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8423cdb2-74da-4042-ba47-4eea34b54969 req-0f060a98-ca6d-4d2d-8f24-aa964de068c4 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:37.383189 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8423cdb2-74da-4042-ba47-4eea34b54969 req-0f060a98-ca6d-4d2d-8f24-aa964de068c4 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 944 time: 0.0490839 Aug 24 03:04:37.388566 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-10d8e95a-2648-455c-aa9f-47d8aae2e012 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:37.396120 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0343af12-8358-4d4d-9d98-d3d483537472 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:37.398656 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0343af12-8358-4d4d-9d98-d3d483537472 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:37.399842 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-0343af12-8358-4d4d-9d98-d3d483537472 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "DELETE /v2.0/floatingips/ebbc0a41-08cf-4f3e-b20a-e2e59171ca53 HTTP/1.1" status: 204 len: 168 time: 1.3982959 Aug 24 03:04:37.436797 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10d8e95a-2648-455c-aa9f-47d8aae2e012 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event deleted for resources: {'Port': ['ID=5a8c0db8-5ba3-46f9-83b2-1e4c5b5e6238,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:37.476316 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-bfa79dd6-8884-4326-b22f-679f3abc5176 service neutron] 10.222.0.43 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1027181 Aug 24 03:04:37.500470 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8423cdb2-74da-4042-ba47-4eea34b54969 req-b9030c0a-1fd9-4d88-bc2d-a3756d3059a9 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1085749 Aug 24 03:04:37.522088 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-10d8e95a-2648-455c-aa9f-47d8aae2e012 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:37.523649 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-10d8e95a-2648-455c-aa9f-47d8aae2e012 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:37.525059 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-10d8e95a-2648-455c-aa9f-47d8aae2e012 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "DELETE /v2.0/floatingips/fec6f3c0-dff8-42a4-ac0a-99b41100efe5 HTTP/1.1" status: 204 len: 168 time: 0.8077352 Aug 24 03:04:37.578864 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d57433c-0be6-455a-89a9-06b358f0b404 req-c8e4eaee-9f8c-45ac-bcc2-da7626cb7f04 service neutron] 10.222.0.43 "GET /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0945327 Aug 24 03:04:37.940917 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37770) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:37.945702 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-4e9cac86-6316-4699-8956-7cd99651d4b0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Request body: {'security_group': {'name': 'tempest-securitygroup--176095213', 'description': 'tempest-description--970728587'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:38.011432 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4e9cac86-6316-4699-8956-7cd99651d4b0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.091442 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4e9cac86-6316-4699-8956-7cd99651d4b0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.148575 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4e9cac86-6316-4699-8956-7cd99651d4b0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.177456 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e9cac86-6316-4699-8956-7cd99651d4b0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event updated for resources: {'SecurityGroup': ['ID=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:38.216697 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37772) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:38.221426 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-bc62b661-8ea2-43fb-a7e2-d8eeb635f7c4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1029914772', 'description': 'tempest-description--770734970'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:38.226844 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4e9cac86-6316-4699-8956-7cd99651d4b0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.229812 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-4e9cac86-6316-4699-8956-7cd99651d4b0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1778 time: 0.2862213 Aug 24 03:04:38.231955 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37774) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:38.236670 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-5132d3e9-5adf-4948-8f59-77de351d9581 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Request body: {'security_group_rule': {'security_group_id': '12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:38.320244 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bc62b661-8ea2-43fb-a7e2-d8eeb635f7c4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.403564 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5132d3e9-5adf-4948-8f59-77de351d9581 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.459413 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bc62b661-8ea2-43fb-a7e2-d8eeb635f7c4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.459880 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5132d3e9-5adf-4948-8f59-77de351d9581 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.531965 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bc62b661-8ea2-43fb-a7e2-d8eeb635f7c4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.558806 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5132d3e9-5adf-4948-8f59-77de351d9581 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.562310 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc62b661-8ea2-43fb-a7e2-d8eeb635f7c4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event updated for resources: {'SecurityGroup': ['ID=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:38.579304 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:04:38.589566 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5132d3e9-5adf-4948-8f59-77de351d9581 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d1bea97a-8592-4321-a48f-a7ee4669752d,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:38.617020 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.630076 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c572698-5e36-4ebd-afc2-f2b90b23aa6e req-e214cc7f-55c0-4960-ac01-8754db6db17b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:38.631573 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2c572698-5e36-4ebd-afc2-f2b90b23aa6e req-e214cc7f-55c0-4960-ac01-8754db6db17b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 944 time: 0.0522234 Aug 24 03:04:38.673183 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2c572698-5e36-4ebd-afc2-f2b90b23aa6e req-5b96b4ee-995b-4639-8f30-3e24a91fde52 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0353916 Aug 24 03:04:38.678208 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bc62b661-8ea2-43fb-a7e2-d8eeb635f7c4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.679452 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-bc62b661-8ea2-43fb-a7e2-d8eeb635f7c4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.4617472 Aug 24 03:04:38.682343 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37778) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:38.691232 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-95d1f59f-d23a-49f9-bb60-8ac2cc037ac9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Request body: {'security_group_rule': {'security_group_id': 'eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:38.709981 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5132d3e9-5adf-4948-8f59-77de351d9581 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.711149 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-5132d3e9-5adf-4948-8f59-77de351d9581 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4781780 Aug 24 03:04:38.714988 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37780) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:38.720942 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-8e08a514-cf0e-440d-8d1d-ad078a094804 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Request body: {'security_group_rule': {'security_group_id': '12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:38.772432 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f1d9c656-6ca6-4c4a-8ec0-82390f07d5d2 req-5c003443-a3f6-4590-8383-87f1628fbdbe service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0378759 Aug 24 03:04:38.846819 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-95d1f59f-d23a-49f9-bb60-8ac2cc037ac9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.875000 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d9c656-6ca6-4c4a-8ec0-82390f07d5d2 req-3c1e7ea3-8fad-4dc5-9057-2f8b19262ad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:38.876466 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f1d9c656-6ca6-4c4a-8ec0-82390f07d5d2 req-3c1e7ea3-8fad-4dc5-9057-2f8b19262ad3 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 1098 time: 0.0629892 Aug 24 03:04:38.899028 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-95d1f59f-d23a-49f9-bb60-8ac2cc037ac9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.913102 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8e08a514-cf0e-440d-8d1d-ad078a094804 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.969221 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8e08a514-cf0e-440d-8d1d-ad078a094804 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:38.986253 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d9c656-6ca6-4c4a-8ec0-82390f07d5d2 req-85b67fff-8a00-4e6f-acc5-f048ac8c4a1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:38.987732 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f1d9c656-6ca6-4c4a-8ec0-82390f07d5d2 req-85b67fff-8a00-4e6f-acc5-f048ac8c4a1b service neutron] 10.222.0.43 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 913 time: 0.0876245 Aug 24 03:04:38.988776 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-95d1f59f-d23a-49f9-bb60-8ac2cc037ac9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.014593 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95d1f59f-d23a-49f9-bb60-8ac2cc037ac9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a2c44c56-c9db-4b4c-91b8-9ae1ed0bd7b0,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:39.051403 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8e08a514-cf0e-440d-8d1d-ad078a094804 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.068937 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e08a514-cf0e-440d-8d1d-ad078a094804 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fea04595-5065-4140-860c-76810e220a1f,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:39.085117 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-95d1f59f-d23a-49f9-bb60-8ac2cc037ac9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.086328 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-95d1f59f-d23a-49f9-bb60-8ac2cc037ac9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4026515 Aug 24 03:04:39.089881 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37782) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:39.094534 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-f5138a3d-51e7-46f8-b17f-491bb2fd4079 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Request body: {'security_group_rule': {'security_group_id': 'eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:39.097524 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f1d9c656-6ca6-4c4a-8ec0-82390f07d5d2 req-cf06ae08-6a59-4ec4-8d0a-9fb1d7d947a6 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=894657b8-22e4-4340-af94-46bb6d84e3d7 HTTP/1.1" status: 200 len: 1000 time: 0.0944970 Aug 24 03:04:39.149720 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d9c656-6ca6-4c4a-8ec0-82390f07d5d2 req-b3ec6390-f1f9-482f-9231-ab496cef81d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:39.150526 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8e08a514-cf0e-440d-8d1d-ad078a094804 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.151751 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f1d9c656-6ca6-4c4a-8ec0-82390f07d5d2 req-b3ec6390-f1f9-482f-9231-ab496cef81d3 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 200 len: 851 time: 0.0458534 Aug 24 03:04:39.152701 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-8e08a514-cf0e-440d-8d1d-ad078a094804 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4366679 Aug 24 03:04:39.155701 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 37784) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:39.159953 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Request body: {'floatingip': {'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:39.205991 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d9c656-6ca6-4c4a-8ec0-82390f07d5d2 req-94f6a708-29c1-4479-8847-b93903e98627 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:39.207466 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f1d9c656-6ca6-4c4a-8ec0-82390f07d5d2 req-94f6a708-29c1-4479-8847-b93903e98627 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0485973 Aug 24 03:04:39.295823 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5138a3d-51e7-46f8-b17f-491bb2fd4079 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.301850 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f1d9c656-6ca6-4c4a-8ec0-82390f07d5d2 req-022f0a4e-5f04-4c71-b797-306b70832f74 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833931 Aug 24 03:04:39.362441 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5138a3d-51e7-46f8-b17f-491bb2fd4079 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.364168 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.394866 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f1d9c656-6ca6-4c4a-8ec0-82390f07d5d2 req-ec3b088e-98c4-488d-aa16-cf567b028fb3 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826533 Aug 24 03:04:39.430343 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5138a3d-51e7-46f8-b17f-491bb2fd4079 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.454409 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5138a3d-51e7-46f8-b17f-491bb2fd4079 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=799088ae-a515-442c-9acf-ad068e456947,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:39.481242 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.516378 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f5138a3d-51e7-46f8-b17f-491bb2fd4079 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.517556 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-f5138a3d-51e7-46f8-b17f-491bb2fd4079 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4266763 Aug 24 03:04:39.520791 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37786) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:39.559811 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 714fff03-ce7b-45d9-b398-7272d616dd68 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:04:39.591014 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Allocated IP 172.27.2.171 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/5cd27a18-25a8-4724-8f22-a21e62260ab5) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:04:39.624254 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Request body: {'floatingip': {'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:39.662787 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 714fff03-ce7b-45d9-b398-7272d616dd68, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=714fff03-ce7b-45d9-b398-7272d616dd68,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:39.673909 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '714fff03-ce7b-45d9-b398-7272d616dd68', 'network_id': 'a8a02a2d-c194-4f2f-9653-b6e128589efc', 'port_id': '714fff03-ce7b-45d9-b398-7272d616dd68', 'mac_address': 'fa:16:3e:0c:4f:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 382, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '05cef140-037d-459e-a03d-a6915273f9d4', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:04:39.694927 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.716401 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.730203 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 714fff03-ce7b-45d9-b398-7272d616dd68 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:04:39.730460 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.751002 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 714fff03-ce7b-45d9-b398-7272d616dd68, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=714fff03-ce7b-45d9-b398-7272d616dd68,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:39.795988 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cb9d17b-5fe7-47f3-a1a4-40ba144c41cd req-7feecd6f-5a8a-4bde-86b8-59c4bb653cc2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:39.797531 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2cb9d17b-5fe7-47f3-a1a4-40ba144c41cd req-7feecd6f-5a8a-4bde-86b8-59c4bb653cc2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 944 time: 0.0511491 Aug 24 03:04:39.825279 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.834490 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.877733 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2cb9d17b-5fe7-47f3-a1a4-40ba144c41cd req-4a879e1d-2496-4271-84a0-5b065d2a85f9 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739546 Aug 24 03:04:39.880806 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:04:39.883612 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:04:39.887656 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:39.890919 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:04:39.899376 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event updated for resources: {'Port': ['ID=5cd27a18-25a8-4724-8f22-a21e62260ab5,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:39.941495 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=714fff03-ce7b-45d9-b398-7272d616dd68,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:39.952964 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Allocated IP 172.27.2.57 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/b21cf6c9-5a8f-4ac3-bafa-4fb97bd3f188) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:04:39.983183 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.054414 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.144869 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.183667 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['714fff03-ce7b-45d9-b398-7272d616dd68'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:04:40.234669 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.281719 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:04:40.284831 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:04:40.288232 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:04:40.300238 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.314362 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event updated for resources: {'Port': ['ID=b21cf6c9-5a8f-4ac3-bafa-4fb97bd3f188,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:40.359686 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.380633 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.428532 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event updated for resources: {'Port': ['ID=5cd27a18-25a8-4724-8f22-a21e62260ab5,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:40.440149 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.481883 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.506680 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.507924 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-fe0aa93e-4074-4d93-9fb6-9f17ba90d00e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.3513272 Aug 24 03:04:40.630736 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for port, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.690033 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-e1e6b185-7924-486a-9f81-0059e83fd578 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--176095213&fields=id&tenant_id=6b319ec439ef48f18d76e47df6300bc6 HTTP/1.1" status: 200 len: 267 time: 0.0326648 Aug 24 03:04:40.708238 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3484283'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.835371 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event updated for resources: {'Port': ['ID=b21cf6c9-5a8f-4ac3-bafa-4fb97bd3f188,revision_number=2']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:40.859545 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:40.869143 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-e0260c59-dff9-4d05-934d-988b622e92c2 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:40.871222 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-e0260c59-dff9-4d05-934d-988b622e92c2 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/networks?id=72400947-ffa3-49a8-8805-03fdb89d0cfb HTTP/1.1" status: 200 len: 817 time: 0.1720343 Aug 24 03:04:40.887695 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-65daed43-3bdb-4ba5-a203-2df7d303d1de tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/quotas/6b319ec439ef48f18d76e47df6300bc6 HTTP/1.1" status: 200 len: 375 time: 0.0102577 Aug 24 03:04:40.940913 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-8caa47f2-2691-4347-b994-63e3062b711c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=6b319ec439ef48f18d76e47df6300bc6&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0474703 Aug 24 03:04:40.997130 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909b6c02-4471-46d1-a8d6-8bd9c2a1fa2a req-4f1f200e-cae9-4e9a-a942-b1c74f6bfd2c tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:40.998641 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-909b6c02-4471-46d1-a8d6-8bd9c2a1fa2a req-4f1f200e-cae9-4e9a-a942-b1c74f6bfd2c tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 945 time: 0.0511279 Aug 24 03:04:41.002338 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:41.003518 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-19bbb8b6-5dff-4b76-8ef0-6a18dd65f1c3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.4817154 Aug 24 03:04:41.040785 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-909b6c02-4471-46d1-a8d6-8bd9c2a1fa2a req-d3241be2-68cb-47d1-b6a9-9bec61b4fa55 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358453 Aug 24 03:04:41.043630 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-8973c1c4-973b-4aee-a04f-bb33325db49e service neutron] 10.222.0.30 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907838 Aug 24 03:04:41.139400 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-76464ad1-1529-45a4-a32f-b78cb0dc0df6 service neutron] 10.222.0.30 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893927 Aug 24 03:04:41.162113 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-990576d5-363c-4a89-b0c6-fe6384d54c8e tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1029914772&fields=id&tenant_id=7e23b688defc49bc8fa4cf796a1bc390 HTTP/1.1" status: 200 len: 267 time: 0.0335884 Aug 24 03:04:41.270069 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-da5e293f-a475-4220-b33e-977da943eae4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:41.271519 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-da5e293f-a475-4220-b33e-977da943eae4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/networks?id=f35e751d-f371-4788-abda-6a58b8a779df HTTP/1.1" status: 200 len: 810 time: 0.1021166 Aug 24 03:04:41.285968 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-938e7072-874b-4b9c-9d24-1feab24985a3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/quotas/7e23b688defc49bc8fa4cf796a1bc390 HTTP/1.1" status: 200 len: 375 time: 0.0086653 Aug 24 03:04:41.338782 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-60bd4d24-1619-414f-a1ad-71b6dd7c9f61 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0475295 Aug 24 03:04:41.421411 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-19fdc8f7-8f53-47c9-a9d9-09a160760d7a req-7322f1ce-a29f-4069-a391-c466ead19057 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 210 time: 0.0333683 Aug 24 03:04:41.447165 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-ca35f8e1-c9eb-4389-9f7b-85fa3b58249d service neutron] 10.222.0.30 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0950992 Aug 24 03:04:41.535834 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-c3a1761f-9628-4a86-b2b5-b867ba5263be service neutron] 10.222.0.30 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845075 Aug 24 03:04:41.592103 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 714fff03-ce7b-45d9-b398-7272d616dd68 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:04:41.690497 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 714fff03-ce7b-45d9-b398-7272d616dd68 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:04:41.694546 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 714fff03-ce7b-45d9-b398-7272d616dd68 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:04:41.694921 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:41.753489 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c3c2d99e-3d53-4486-8503-6680241497fa req-7161bc8f-4152-490c-afae-6c45458318c8 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 210 time: 0.0258780 Aug 24 03:04:41.778850 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:41.804102 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d327609-1228-4ab7-b533-aaa4697437f3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '714fff03-ce7b-45d9-b398-7272d616dd68'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:41.806761 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77b77da3-25e4-471f-88af-cd5cde43a06b" -d '{"events": [{"server_uuid": "6d327609-1228-4ab7-b533-aaa4697437f3", "name": "network-vif-plugged", "status": "completed", "tag": "714fff03-ce7b-45d9-b398-7272d616dd68"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:41.821513 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 714fff03-ce7b-45d9-b398-7272d616dd68, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=714fff03-ce7b-45d9-b398-7272d616dd68,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:41.849847 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a257716e-3c5d-4826-9629-b8dd04b23ba0 x-openstack-request-id: req-a257716e-3c5d-4826-9629-b8dd04b23ba0 {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:41.850143 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d327609-1228-4ab7-b533-aaa4697437f3", "name": "network-vif-plugged", "status": "completed", "tag": "714fff03-ce7b-45d9-b398-7272d616dd68", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:41.850423 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-a257716e-3c5d-4826-9629-b8dd04b23ba0 {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:41.850819 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d327609-1228-4ab7-b533-aaa4697437f3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '714fff03-ce7b-45d9-b398-7272d616dd68', 'code': 200} Aug 24 03:04:41.903081 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:41.955888 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=714fff03-ce7b-45d9-b398-7272d616dd68,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:42.169045 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca176e3-3384-477e-85ed-aed0ed66466a req-ffebe59d-b7dd-4852-83ea-d34b2c282423 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:42.173763 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9ca176e3-3384-477e-85ed-aed0ed66466a req-ffebe59d-b7dd-4852-83ea-d34b2c282423 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 946 time: 0.0533133 Aug 24 03:04:42.212574 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9ca176e3-3384-477e-85ed-aed0ed66466a req-c0c7c206-bffb-4f50-923b-4e6193078c8d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357456 Aug 24 03:04:42.274567 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ff235d-87b5-4e31-883b-2b9fb92a61d1 req-9a11e459-f5c3-436f-8d95-5994bf73afee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:42.276683 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a6ff235d-87b5-4e31-883b-2b9fb92a61d1 req-9a11e459-f5c3-436f-8d95-5994bf73afee service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 1099 time: 0.0385287 Aug 24 03:04:42.323568 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a6ff235d-87b5-4e31-883b-2b9fb92a61d1 req-391b15b7-4032-4c14-b3b8-cd22a01265c5 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0334177 Aug 24 03:04:42.521032 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-463342d9-2f4b-425f-b5d7-dd5735fd06b0 req-95aaef90-540b-49df-924c-aa5849c28e93 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 210 time: 0.0274076 Aug 24 03:04:42.852966 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ec0f7085-989c-40fe-acd5-22d8d0f49cf5 req-ac44a8a6-d0e6-404d-a2c5-c783ccb4b22d tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 210 time: 0.0287287 Aug 24 03:04:43.331478 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e4e043b-e3fb-4e27-ac03-c5c9e1c90b16 req-5b2565fa-f0f1-44a4-a8b2-7beeaa203114 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:43.332937 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5e4e043b-e3fb-4e27-ac03-c5c9e1c90b16 req-5b2565fa-f0f1-44a4-a8b2-7beeaa203114 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 946 time: 0.0506454 Aug 24 03:04:43.377189 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5e4e043b-e3fb-4e27-ac03-c5c9e1c90b16 req-d076ded3-d633-44df-bd4e-7032aec00ce7 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382154 Aug 24 03:04:43.616965 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4368fa45-5387-4b32-85dd-56620c591769 req-d1196535-025b-4ed3-ab07-f3aea1a71917 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 210 time: 0.0253482 Aug 24 03:04:43.859592 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-e184cbea-980c-4e3d-8222-371dea189eaf tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:43.861042 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-e184cbea-980c-4e3d-8222-371dea189eaf tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.43 "GET /v2.0/networks?id=72400947-ffa3-49a8-8805-03fdb89d0cfb HTTP/1.1" status: 200 len: 817 time: 0.1032612 Aug 24 03:04:43.921423 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-f69b0630-ebd1-4b0b-99d0-237bce843419 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.43 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6b319ec439ef48f18d76e47df6300bc6 HTTP/1.1" status: 200 len: 379 time: 0.0460494 Aug 24 03:04:43.932402 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Request body: {'port': {'device_id': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'admin_state_up': True, 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'security_groups': ['12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d']}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:43.953975 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f065983b-82dd-4f63-ad05-990609d3d6ec req-54b53fc5-4a36-427b-9e3d-37fcd882cd54 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 210 time: 0.0325739 Aug 24 03:04:44.108359 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Made reservation on behalf of 6b319ec439ef48f18d76e47df6300bc6 for: {'port': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:04:44.111967 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:44.236723 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Allocated IP 172.20.0.13 (72400947-ffa3-49a8-8805-03fdb89d0cfb/465e9b83-ccde-4ea3-8e80-86590891b03c/11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:04:44.366749 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:44.381111 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.provisioning_blocks [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Transition to ACTIVE for port object 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 will not be triggered until provisioned by entity DHCP. {{(pid=111275) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:04:44.473375 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:44.531361 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578b334c-c889-4b54-af4a-d67fcc4dddf9 req-5d4fecc6-39ef-4bde-b5d4-3bae5f5b14b3 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:44.532861 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-578b334c-c889-4b54-af4a-d67fcc4dddf9 req-5d4fecc6-39ef-4bde-b5d4-3bae5f5b14b3 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 946 time: 0.0894890 Aug 24 03:04:44.534883 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Network 72400947-ffa3-49a8-8805-03fdb89d0cfb is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:04:44.540157 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-30759142-b96f-4cee-8891-a5d9db9e1c88 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:44.541843 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-30759142-b96f-4cee-8891-a5d9db9e1c88 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.43 "GET /v2.0/networks?id=f35e751d-f371-4788-abda-6a58b8a779df HTTP/1.1" status: 200 len: 810 time: 0.1043825 Aug 24 03:04:44.541973 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:04:44.555571 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:04:44.578863 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event updated for resources: {'Port': ['ID=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:44.590406 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-0fb1d91c-23bd-44c8-8cc4-640943c99432 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.43 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7e23b688defc49bc8fa4cf796a1bc390 HTTP/1.1" status: 200 len: 380 time: 0.0377233 Aug 24 03:04:44.600867 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Request body: {'port': {'device_id': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'admin_state_up': True, 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'security_groups': ['eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e']}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:44.617998 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:44.617998 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:44.644728 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-578b334c-c889-4b54-af4a-d67fcc4dddf9 req-70343f96-91c6-41f9-8b09-dc29e732358e tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1039758 Aug 24 03:04:44.726709 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2cf107da-ae8a-4eec-b0dc-b219e2fd3ca5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7980218 Aug 24 03:04:44.745332 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Request body: {'port': {'device_id': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:44.812041 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:44.890978 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-155d65e6-8ba1-493c-8fad-0d5e9352cd3e None None] Provisioning for port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:04:44.900211 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-155d65e6-8ba1-493c-8fad-0d5e9352cd3e None None] Provisioning complete for port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:04:44.902522 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-155d65e6-8ba1-493c-8fad-0d5e9352cd3e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:44.945371 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-155d65e6-8ba1-493c-8fad-0d5e9352cd3e None None] Port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:04:45.023188 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a629386-7f64-4612-ae4c-2f2662e2bdde req-d8cf29c3-63ab-4060-bff1-13905699ab71 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:45.024696 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4a629386-7f64-4612-ae4c-2f2662e2bdde req-d8cf29c3-63ab-4060-bff1-13905699ab71 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 932 time: 0.0850012 Aug 24 03:04:45.073226 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a36c226e-0ce4-44f9-b60e-4813c636eee7 req-c75483c0-53d9-4e75-af6d-c6035a49348b tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 210 time: 0.0379641 Aug 24 03:04:45.086144 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4a629386-7f64-4612-ae4c-2f2662e2bdde req-6b485e67-f152-4645-8747-9f2226d8ed82 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0504880 Aug 24 03:04:45.130017 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 {{(pid=111275) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:04:45.138099 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Notify callbacks [] for port, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:45.149427 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.provisioning_blocks [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Transition to ACTIVE for port object 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 will not be triggered until provisioned by entity L2. {{(pid=111275) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:04:45.163346 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Made reservation on behalf of 7e23b688defc49bc8fa4cf796a1bc390 for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:04:45.166813 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:45.295710 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Allocated IP 172.20.0.10 (f35e751d-f371-4788-abda-6a58b8a779df/14102a94-a55b-43e1-a7a9-4210a4c2e2fb/cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:04:45.354318 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3484283'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:45.412992 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Pushing event updated for resources: {'Port': ['ID=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,revision_number=2']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:45.485165 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:45.486517 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.managers [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Attempting to bind port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:04:45.486863 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.managers [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Attempting to bind port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'}] {{(pid=111275) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:04:45.487210 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Attempting to bind port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 on network 72400947-ffa3-49a8-8805-03fdb89d0cfb {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:04:45.491811 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 on network 72400947-ffa3-49a8-8805-03fdb89d0cfb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:04:45.492137 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Attempting to bind port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 on network 72400947-ffa3-49a8-8805-03fdb89d0cfb {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:04:45.498112 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 4, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:04:45.498512 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Checking segment: {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:04:45.498837 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Bound using segment: {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'} {{(pid=111275) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:04:45.499264 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.managers [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Bound port: 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f890483e-ac55-4cdc-9004-ef9743d5959e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb'}}] {{(pid=111275) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:04:45.499617 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:45.500934 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Transition to ACTIVE for port object cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:04:45.567839 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, cleared binding levels {{(pid=111275) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:04:45.571108 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111275) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:04:45.633126 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:45.633322 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3484283'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:45.670624 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:45.671218 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:45.672682 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] 10.222.0.43 "PUT /v2.0/ports/11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 HTTP/1.1" status: 200 len: 1094 time: 0.9319305 Aug 24 03:04:45.673021 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:45.675438 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f2a2175-7484-4dc4-bc0a-7967b7a7b2e3" -d '{"events": [{"name": "network-changed", "server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:45.682064 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Network f35e751d-f371-4788-abda-6a58b8a779df is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:04:45.685608 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:04:45.688206 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:04:45.709423 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0abeb418-0446-48b2-8fe4-13498332c9fd service neutron] Pushing event updated for resources: {'Port': ['ID=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,revision_number=3']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:45.728745 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event updated for resources: {'Port': ['ID=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:45.746405 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f834753-bc52-4265-8fbd-70b0668f079f x-openstack-request-id: req-2f834753-bc52-4265-8fbd-70b0668f079f {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:45.746871 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:45.747166 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-2f834753-bc52-4265-8fbd-70b0668f079f {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:45.748146 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'status': 'completed', 'code': 200} Aug 24 03:04:45.768057 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:45.768057 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:45.811744 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2a2175-7484-4dc4-bc0a-7967b7a7b2e3 req-16dcb95a-b685-4cdf-bfec-500ec2cef1c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:45.813341 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1f2a2175-7484-4dc4-bc0a-7967b7a7b2e3 req-16dcb95a-b685-4cdf-bfec-500ec2cef1c6 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=6b319ec439ef48f18d76e47df6300bc6&device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 1097 time: 0.0462196 Aug 24 03:04:45.846055 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-97d38b2e-66e1-4d0c-af53-fa159925458f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2489579 Aug 24 03:04:45.861967 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Request body: {'port': {'device_id': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:45.924859 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:45.927521 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2a2175-7484-4dc4-bc0a-7967b7a7b2e3 req-d1fab500-9904-4021-902d-0635ec3b8550 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:45.929330 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1f2a2175-7484-4dc4-bc0a-7967b7a7b2e3 req-d1fab500-9904-4021-902d-0635ec3b8550 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=6b319ec439ef48f18d76e47df6300bc6&shared=False HTTP/1.1" status: 200 len: 918 time: 0.1042430 Aug 24 03:04:46.034222 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2a2175-7484-4dc4-bc0a-7967b7a7b2e3 req-1f8f8c97-da35-4551-ac6f-9ae1f9fb129e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:46.035763 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1f2a2175-7484-4dc4-bc0a-7967b7a7b2e3 req-1f8f8c97-da35-4551-ac6f-9ae1f9fb129e service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0901408 Aug 24 03:04:46.097376 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-acd533ce-a15d-4ed3-99fa-a38f8e86efc0 None None] Provisioning for port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:04:46.105562 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-acd533ce-a15d-4ed3-99fa-a38f8e86efc0 None None] Provisioning complete for port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:04:46.105974 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-acd533ce-a15d-4ed3-99fa-a38f8e86efc0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:46.120349 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-6740e880-b4c4-4d9a-adfa-8ec2a7fe14b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:46.122293 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-6740e880-b4c4-4d9a-adfa-8ec2a7fe14b9 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=6b319ec439ef48f18d76e47df6300bc6&device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 1097 time: 0.0471845 Aug 24 03:04:46.147349 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-acd533ce-a15d-4ed3-99fa-a38f8e86efc0 None None] Port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:04:46.182453 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-5d027529-1d0f-4980-bbc1-bb15506db79e service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 HTTP/1.1" status: 200 len: 217 time: 0.0505123 Aug 24 03:04:46.232435 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:04:46.241934 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:46.258911 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Transition to ACTIVE for port object cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:04:46.262031 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-e426f5c5-5ca2-46fe-ad68-851fd1ddb24d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:46.263493 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-e426f5c5-5ca2-46fe-ad68-851fd1ddb24d service neutron] 10.222.0.43 "GET /v2.0/subnets?id=465e9b83-ccde-4ea3-8e80-86590891b03c HTTP/1.1" status: 200 len: 856 time: 0.0743899 Aug 24 03:04:46.266396 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ac4693-771e-44b2-ae7b-165a707cc0cb req-fc3b35ec-d45a-4982-a8e9-657512cf6263 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:46.267880 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-83ac4693-771e-44b2-ae7b-165a707cc0cb req-fc3b35ec-d45a-4982-a8e9-657512cf6263 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 932 time: 0.0738680 Aug 24 03:04:46.275407 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df1c9ab-a14c-4543-ac6d-4c8a03d6951c req-68b461ec-64a7-4081-8c23-8e5b61aae53b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:46.277343 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7df1c9ab-a14c-4543-ac6d-4c8a03d6951c req-68b461ec-64a7-4081-8c23-8e5b61aae53b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0805423 Aug 24 03:04:46.309469 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-83ac4693-771e-44b2-ae7b-165a707cc0cb req-148b4bd6-2981-4de0-a411-94177a254d4e tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0348034 Aug 24 03:04:46.314800 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:46.356536 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7df1c9ab-a14c-4543-ac6d-4c8a03d6951c req-78022c60-c6b9-4f17-a708-fa565b798b39 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0695026 Aug 24 03:04:46.362465 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-cce03845-9754-4f1d-b608-186255ffed88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:46.367415 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-cce03845-9754-4f1d-b608-186255ffed88 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=72400947-ffa3-49a8-8805-03fdb89d0cfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0885656 Aug 24 03:04:46.370484 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Pushing event updated for resources: {'Port': ['ID=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:46.457663 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Attempting to bind port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:04:46.458043 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Attempting to bind port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:04:46.458434 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Attempting to bind port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 on network f35e751d-f371-4788-abda-6a58b8a779df {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:04:46.463643 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 on network f35e751d-f371-4788-abda-6a58b8a779df not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:04:46.464052 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Attempting to bind port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 on network f35e751d-f371-4788-abda-6a58b8a779df {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:04:46.469927 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 4, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:04:46.470279 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Checking segment: {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:04:46.470669 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Bound using segment: {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:04:46.471095 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Bound port: cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f363f36-ab44-420b-9a62-ff7330e4d1b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:04:46.471478 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:46.546374 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] For port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:04:46.550233 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] For port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:04:46.690264 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:46.715755 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-d69eb1f4-fe6e-4e0e-8c80-795afa5dd80f service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3385253 Aug 24 03:04:46.726537 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:46.727170 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:46.728542 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] 10.222.0.43 "PUT /v2.0/ports/cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 HTTP/1.1" status: 200 len: 1094 time: 0.8712068 Aug 24 03:04:46.728941 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'tag': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:46.731924 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7f3f5cf2-a89b-4848-af27-2873bfd0fd5b" -d '{"events": [{"name": "network-changed", "server_uuid": "18b2a8a2-7207-4a38-a394-1389dfb35117", "tag": "cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:46.758506 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aa2cc3e-bf9c-41ac-9e82-3ce3dc30452f service neutron] Pushing event updated for resources: {'Port': ['ID=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:46.774435 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e373e83a-aa16-411d-b21f-25e52533a475 x-openstack-request-id: req-e373e83a-aa16-411d-b21f-25e52533a475 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:46.774822 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "18b2a8a2-7207-4a38-a394-1389dfb35117", "tag": "cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:46.774986 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e373e83a-aa16-411d-b21f-25e52533a475 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:46.775402 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'tag': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3', 'status': 'completed', 'code': 200} Aug 24 03:04:46.847657 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3f5cf2-a89b-4848-af27-2873bfd0fd5b req-7d4a522d-9885-424d-88aa-5d772536e673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:46.849314 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7f3f5cf2-a89b-4848-af27-2873bfd0fd5b req-7d4a522d-9885-424d-88aa-5d772536e673 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 1097 time: 0.0517147 Aug 24 03:04:46.887266 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-487b16ac-bfa0-4572-b759-ef3a016dbc89 req-2113644c-307e-4e70-aa24-fe06ed6a4a9a service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1522477 Aug 24 03:04:46.951901 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3f5cf2-a89b-4848-af27-2873bfd0fd5b req-c6460a5d-743d-4f58-bbc6-5e25f63dc2dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:46.953309 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7f3f5cf2-a89b-4848-af27-2873bfd0fd5b req-c6460a5d-743d-4f58-bbc6-5e25f63dc2dc service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&shared=False HTTP/1.1" status: 200 len: 911 time: 0.0945489 Aug 24 03:04:47.062371 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3f5cf2-a89b-4848-af27-2873bfd0fd5b req-6745cfb7-fd8b-450b-b541-0124638b5399 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:47.063795 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7f3f5cf2-a89b-4848-af27-2873bfd0fd5b req-6745cfb7-fd8b-450b-b541-0124638b5399 service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0917575 Aug 24 03:04:47.143368 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-72ca6991-13ed-4237-a28c-a1465dc3dbb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:47.144961 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-72ca6991-13ed-4237-a28c-a1465dc3dbb6 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 1097 time: 0.0414472 Aug 24 03:04:47.190818 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-c95428f9-6deb-453c-b5fb-9aca5f259122 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 HTTP/1.1" status: 200 len: 217 time: 0.0373616 Aug 24 03:04:47.241162 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-c5f59e45-5be3-4027-b933-c13dfdb94f65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:47.242650 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-c5f59e45-5be3-4027-b933-c13dfdb94f65 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=14102a94-a55b-43e1-a7a9-4210a4c2e2fb HTTP/1.1" status: 200 len: 849 time: 0.0433815 Aug 24 03:04:47.291293 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-f3c58807-a142-455e-8e28-11061c4e6e59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:47.293041 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-f3c58807-a142-455e-8e28-11061c4e6e59 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=f35e751d-f371-4788-abda-6a58b8a779df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0403214 Aug 24 03:04:47.393555 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-f105eb85-85cd-4fcf-a149-7c59d842524d service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0915139 Aug 24 03:04:47.444840 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bbbf596-55ea-45ba-8696-bd1366fe382a req-418dec52-09d2-4e30-a307-220919f2729f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:47.452922 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4bbbf596-55ea-45ba-8696-bd1366fe382a req-418dec52-09d2-4e30-a307-220919f2729f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 944 time: 0.0634732 Aug 24 03:04:47.490402 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4bbbf596-55ea-45ba-8696-bd1366fe382a req-1f4f2a2b-7da6-49af-91aa-004d0a846411 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0363214 Aug 24 03:04:47.533712 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fa44699-43e4-462b-abaf-3e3458646158 req-09a8e225-ee99-4e7f-b164-97ae0b8473d0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:47.537480 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0fa44699-43e4-462b-abaf-3e3458646158 req-09a8e225-ee99-4e7f-b164-97ae0b8473d0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0818503 Aug 24 03:04:47.537480 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064e4222-1c8b-4a10-b13e-59b98a69464a req-735d0875-72eb-4a95-860e-0e3b115a1e72 service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1331835 Aug 24 03:04:47.574275 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0fa44699-43e4-462b-abaf-3e3458646158 req-a66ce6af-53af-44b9-b1f2-ff1c84ca9b2c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0320637 Aug 24 03:04:48.599358 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b35b6a2-1ae7-446e-bf71-f57f8b675f6b req-1e1dd488-f1d2-4888-bd00-e96cc49c71b0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:48.600809 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7b35b6a2-1ae7-446e-bf71-f57f8b675f6b req-1e1dd488-f1d2-4888-bd00-e96cc49c71b0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 944 time: 0.0473657 Aug 24 03:04:48.639209 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7b35b6a2-1ae7-446e-bf71-f57f8b675f6b req-3a29fdab-58d9-4924-9f4e-26c15ede630c tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314586 Aug 24 03:04:48.692260 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a5594d-ec2e-4d62-b2e1-a7ded675746c req-aea284b4-6b97-4e5a-8ce7-603755294a1c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:48.693735 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a7a5594d-ec2e-4d62-b2e1-a7ded675746c req-aea284b4-6b97-4e5a-8ce7-603755294a1c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0486364 Aug 24 03:04:48.731511 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a7a5594d-ec2e-4d62-b2e1-a7ded675746c req-2ff98f06-3f94-49c5-bd23-1297860a2575 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309894 Aug 24 03:04:49.601757 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:04:49.697804 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:49.708252 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'port_id': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'mac_address': 'fa:16:3e:0a:41:69', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:04:49.745898 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:49.756130 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-446c99ea-f2a3-4b06-a659-f0d14305ea0f req-6bb949b9-ccba-4194-8eb9-33158f9bc5cf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:49.759357 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:04:49.764406 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-446c99ea-f2a3-4b06-a659-f0d14305ea0f req-6bb949b9-ccba-4194-8eb9-33158f9bc5cf tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 944 time: 0.0579398 Aug 24 03:04:49.780167 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:49.802700 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-446c99ea-f2a3-4b06-a659-f0d14305ea0f req-1cad3479-f5d0-47c6-afb3-69d6c1d871af tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0319989 Aug 24 03:04:49.848375 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76f6ffa-2cef-43f6-8c0c-b468888d80dc req-22332b07-7bb5-4cb7-843b-511133f3904b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:49.849917 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e76f6ffa-2cef-43f6-8c0c-b468888d80dc req-22332b07-7bb5-4cb7-843b-511133f3904b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0493240 Aug 24 03:04:49.851255 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:49.851938 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:04:49.887413 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e76f6ffa-2cef-43f6-8c0c-b468888d80dc req-ea54cc3f-4b65-494c-bc22-e797780a71e2 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0307865 Aug 24 03:04:49.949935 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:50.031860 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:50.049029 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'port_id': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3', 'mac_address': 'fa:16:3e:00:32:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 355, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:04:50.211220 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:50.251958 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:04:50.279123 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:50.336892 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:50.383134 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:50.666307 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:04:50.669915 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:04:50.915831 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-253101ed-1369-4772-b044-71bdfeede6a6 req-46653d50-cc31-4640-a56f-36cf80446966 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:50.917305 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-253101ed-1369-4772-b044-71bdfeede6a6 req-46653d50-cc31-4640-a56f-36cf80446966 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 945 time: 0.0484400 Aug 24 03:04:50.955200 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-253101ed-1369-4772-b044-71bdfeede6a6 req-48c261f4-1dee-4cc2-b88a-9a211d091a4e tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0320253 Aug 24 03:04:51.010001 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae1dfda-eee8-425f-bba6-59cb8f86eadf req-c5213ea1-8dc4-47cc-9f04-ffc538e1885b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:51.011505 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fae1dfda-eee8-425f-bba6-59cb8f86eadf req-c5213ea1-8dc4-47cc-9f04-ffc538e1885b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 945 time: 0.0519137 Aug 24 03:04:51.048418 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fae1dfda-eee8-425f-bba6-59cb8f86eadf req-e8afa8a4-6113-43fe-bde8-420fb53c974f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0311081 Aug 24 03:04:51.409043 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-ae872c80-df86-48f1-aa8c-2daceb52f767 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:52.070042 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afe28749-630d-4f7c-8a58-77e9ddf163e5 req-a1785ca7-f543-4703-a5be-fa0331c1eda9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:52.071495 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-afe28749-630d-4f7c-8a58-77e9ddf163e5 req-a1785ca7-f543-4703-a5be-fa0331c1eda9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 945 time: 0.0485492 Aug 24 03:04:52.109863 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-afe28749-630d-4f7c-8a58-77e9ddf163e5 req-6a0ebfb3-f5d8-46aa-9459-de70e2aee4be tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314405 Aug 24 03:04:52.167014 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69848a3f-5866-47d6-8cd8-57480a424180 req-6a291e3a-fe13-497e-8910-f476685c66da tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:52.168849 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-69848a3f-5866-47d6-8cd8-57480a424180 req-6a291e3a-fe13-497e-8910-f476685c66da tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 945 time: 0.0492914 Aug 24 03:04:52.207150 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-69848a3f-5866-47d6-8cd8-57480a424180 req-924a73b5-6be1-45a3-8317-b91c373abc2f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0322700 Aug 24 03:04:53.231386 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da8cd350-4980-44d1-994c-7c4516fa18c9 req-382d8efd-d927-4f66-9766-5aefbe7a06d0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:53.232662 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-da8cd350-4980-44d1-994c-7c4516fa18c9 req-382d8efd-d927-4f66-9766-5aefbe7a06d0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 945 time: 0.0562105 Aug 24 03:04:53.272708 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-da8cd350-4980-44d1-994c-7c4516fa18c9 req-09a1993f-4d41-485a-a50b-6c1e6944af70 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0340242 Aug 24 03:04:53.326644 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5bf89b-ce0c-4a67-af49-bcfc13cc6dad req-c57350da-2fcc-4fd4-8c66-101e18f7cc54 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:53.328113 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-af5bf89b-ce0c-4a67-af49-bcfc13cc6dad req-c57350da-2fcc-4fd4-8c66-101e18f7cc54 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 945 time: 0.0489841 Aug 24 03:04:53.365365 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-af5bf89b-ce0c-4a67-af49-bcfc13cc6dad req-5d7157e9-71b8-49fe-80da-4abe38688ff4 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313833 Aug 24 03:04:53.622315 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:04:53.753984 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:04:53.758052 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:04:53.758429 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:53.842805 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:53.866096 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:53.868334 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e8cebdc9-b914-46f5-9a48-520c22799b32" -d '{"events": [{"server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "name": "network-vif-plugged", "status": "completed", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:53.888357 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:53.912252 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-427de7b2-2aea-45fd-90b1-b00db8e9bfc5 x-openstack-request-id: req-427de7b2-2aea-45fd-90b1-b00db8e9bfc5 {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:53.912252 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "name": "network-vif-plugged", "status": "completed", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:53.912252 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-427de7b2-2aea-45fd-90b1-b00db8e9bfc5 {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:53.912252 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'code': 200} Aug 24 03:04:54.028433 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:54.029254 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:04:54.032599 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-a3a6889b-4d80-4b72-9451-043126dcceb5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:54.109335 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:54.264666 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:04:54.269249 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:04:54.269713 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:54.321239 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a43fa3ff-ade1-4582-b371-a10fb2805457 req-0a7c3173-add6-4ef7-907d-af051c89102a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:54.321818 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a43fa3ff-ade1-4582-b371-a10fb2805457 req-0a7c3173-add6-4ef7-907d-af051c89102a service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 1099 time: 0.0476925 Aug 24 03:04:54.360599 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:54.368865 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:54.385378 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a43fa3ff-ade1-4582-b371-a10fb2805457 req-e1255370-ea57-42aa-8d69-b5e5c5c4d7d0 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0546746 Aug 24 03:04:54.401228 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:04:54.409149 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc50f8d2-3f88-4af3-addd-37fc4fded78e req-d24291cd-21c1-4daa-af33-619d4af6c6e8 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:54.410681 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bc50f8d2-3f88-4af3-addd-37fc4fded78e req-d24291cd-21c1-4daa-af33-619d4af6c6e8 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 945 time: 0.0561376 Aug 24 03:04:54.450990 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bc50f8d2-3f88-4af3-addd-37fc4fded78e req-c79270a9-d278-4099-b954-f0e3143f81c6 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0345631 Aug 24 03:04:54.490435 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:54.502620 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272682c2-8136-4b65-ad01-d7daa213656c req-a1c34ea2-c4eb-4c58-b81d-8b483b923499 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:54.504176 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-272682c2-8136-4b65-ad01-d7daa213656c req-a1c34ea2-c4eb-4c58-b81d-8b483b923499 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0530105 Aug 24 03:04:54.539120 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:04:54.542319 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-272682c2-8136-4b65-ad01-d7daa213656c req-2f6c87c4-7a52-4b69-8f9a-fd1351e0242d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0318773 Aug 24 03:04:55.553661 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:55.569105 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3949e29-d160-4763-be0b-868cf205ce8a req-ba443f55-c48b-4c45-83c1-5c387aa2b112 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:55.570606 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c3949e29-d160-4763-be0b-868cf205ce8a req-ba443f55-c48b-4c45-83c1-5c387aa2b112 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 946 time: 0.0509326 Aug 24 03:04:55.611301 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c3949e29-d160-4763-be0b-868cf205ce8a req-38de8ee1-ea7c-40b2-8194-fd08f7b2ef82 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0343103 Aug 24 03:04:55.678041 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-965017d3-3959-4b3e-a060-fc776578b89c req-be28ca51-e57d-4c96-aafe-63ec76c9e564 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:55.679910 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-965017d3-3959-4b3e-a060-fc776578b89c req-be28ca51-e57d-4c96-aafe-63ec76c9e564 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0593443 Aug 24 03:04:55.719326 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-965017d3-3959-4b3e-a060-fc776578b89c req-a823525d-edfd-4c15-9b53-93aa35a1861d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0321753 Aug 24 03:04:55.909085 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:55.912031 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7fb360c2-c569-4842-aca5-d92a72f0d2cc" -d '{"events": [{"server_uuid": "18b2a8a2-7207-4a38-a394-1389dfb35117", "name": "network-vif-plugged", "status": "completed", "tag": "cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:55.952405 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c8b7a4a7-24c0-464d-b970-c3597903ddbe x-openstack-request-id: req-c8b7a4a7-24c0-464d-b970-c3597903ddbe {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:55.952824 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "18b2a8a2-7207-4a38-a394-1389dfb35117", "name": "network-vif-plugged", "status": "completed", "tag": "cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:55.953247 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c8b7a4a7-24c0-464d-b970-c3597903ddbe {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:55.953898 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3', 'code': 200} Aug 24 03:04:56.350947 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f74fbf24-35e4-4f5d-b491-c1057cdbe9b7 req-ceae1678-f59d-47ec-a7d7-92e32debfeee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:56.353523 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f74fbf24-35e4-4f5d-b491-c1057cdbe9b7 req-ceae1678-f59d-47ec-a7d7-92e32debfeee service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 1099 time: 0.0475371 Aug 24 03:04:56.396080 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f74fbf24-35e4-4f5d-b491-c1057cdbe9b7 req-6eb813a0-959d-4c09-8723-03c676ecb2d0 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0286629 Aug 24 03:04:56.736239 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da9ac28-d663-413c-b06c-e00b82f3f9cc req-a28597a4-c8ab-4e33-a063-b3b12dcc7f37 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:56.737736 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3da9ac28-d663-413c-b06c-e00b82f3f9cc req-a28597a4-c8ab-4e33-a063-b3b12dcc7f37 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 946 time: 0.0518548 Aug 24 03:04:56.777860 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3da9ac28-d663-413c-b06c-e00b82f3f9cc req-0d0ca7e3-1449-408a-917c-f6d08e1f9874 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0328317 Aug 24 03:04:56.842110 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc64f37-33c0-4ec9-9d92-629f9790bee4 req-62cef2d3-ae8b-4219-baf9-09cae17e364e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:56.843579 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9bc64f37-33c0-4ec9-9d92-629f9790bee4 req-62cef2d3-ae8b-4219-baf9-09cae17e364e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0490413 Aug 24 03:04:56.881695 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9bc64f37-33c0-4ec9-9d92-629f9790bee4 req-5aa36def-351a-4812-a99d-bb621fcee4be tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0322175 Aug 24 03:04:56.954091 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:56.999190 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1cc6936-a62f-4d02-82d3-084f701e102a req-b2b0e244-f7c9-4310-be15-812b160ce953 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:57.000674 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e1cc6936-a62f-4d02-82d3-084f701e102a req-b2b0e244-f7c9-4310-be15-812b160ce953 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0489473 Aug 24 03:04:57.009055 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 37974) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:57.015348 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-bd691247-f0f0-41cf-a572-ccf2cf803dc3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Request body: {'floatingip': {'port_id': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:57.056628 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bd691247-f0f0-41cf-a572-ccf2cf803dc3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:57.524458 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bd691247-f0f0-41cf-a572-ccf2cf803dc3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:57.582860 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bd691247-f0f0-41cf-a572-ccf2cf803dc3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:57.689002 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.l3_db [None req-bd691247-f0f0-41cf-a572-ccf2cf803dc3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Floating IP b37e0710-3186-4170-9811-0e1e7a33642b associated. External IP: 172.27.2.171, port: 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09. Aug 24 03:04:57.951084 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d47a89e-8a70-4830-87f3-a70e848f4ecd req-3ebb3fd4-388c-4d6a-a696-fc0b7fb7b842 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:57.952538 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9d47a89e-8a70-4830-87f3-a70e848f4ecd req-3ebb3fd4-388c-4d6a-a696-fc0b7fb7b842 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 946 time: 0.1075308 Aug 24 03:04:57.956750 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd691247-f0f0-41cf-a572-ccf2cf803dc3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Router 0195ba54-f802-48e9-b0df-bdb173e4aa57 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:04:58.040527 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9d47a89e-8a70-4830-87f3-a70e848f4ecd req-386f93c2-a4ad-4b22-b8ab-3fa743f76ebd tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0809581 Aug 24 03:04:58.103071 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd691247-f0f0-41cf-a572-ccf2cf803dc3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:04:58.108704 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bd691247-f0f0-41cf-a572-ccf2cf803dc3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:58.113226 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9ae91b9-8527-44f8-bc2f-ac4fa50c5036 None None] Sync routers for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:04:58.123352 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9ae91b9-8527-44f8-bc2f-ac4fa50c5036 None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:04:58.124138 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-c9ae91b9-8527-44f8-bc2f-ac4fa50c5036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:04:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:58.138231 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-bd691247-f0f0-41cf-a572-ccf2cf803dc3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "PUT /v2.0/floatingips/b37e0710-3186-4170-9811-0e1e7a33642b HTTP/1.1" status: 200 len: 992 time: 1.1274393 Aug 24 03:04:58.139140 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:04:58.141717 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d4413b83-bc8e-4b81-810d-48b21688758e" -d '{"events": [{"name": "network-changed", "server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:04:58.239132 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:04:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-90bf3cdf-0815-4438-b9d6-6d50eb739e81 x-openstack-request-id: req-90bf3cdf-0815-4438-b9d6-6d50eb739e81 {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:04:58.239410 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:04:58.239668 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-90bf3cdf-0815-4438-b9d6-6d50eb739e81 {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:04:58.240095 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'status': 'completed', 'code': 200} Aug 24 03:04:58.246820 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-c9ae91b9-8527-44f8-bc2f-ac4fa50c5036 None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:04:58.302389 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4413b83-bc8e-4b81-810d-48b21688758e req-c85346a6-184d-48f4-b42f-52cb8a685b86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:58.304041 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d4413b83-bc8e-4b81-810d-48b21688758e req-c85346a6-184d-48f4-b42f-52cb8a685b86 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=6b319ec439ef48f18d76e47df6300bc6&device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 1099 time: 0.0399585 Aug 24 03:04:58.402129 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4413b83-bc8e-4b81-810d-48b21688758e req-b37283cf-c1c3-4ee0-9c55-3e69141df4db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:58.403602 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d4413b83-bc8e-4b81-810d-48b21688758e req-b37283cf-c1c3-4ee0-9c55-3e69141df4db service neutron] 10.222.0.43 "GET /v2.0/networks?id=72400947-ffa3-49a8-8805-03fdb89d0cfb HTTP/1.1" status: 200 len: 918 time: 0.0925419 Aug 24 03:04:58.468299 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-c9ae91b9-8527-44f8-bc2f-ac4fa50c5036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'b37e0710-3186-4170-9811-0e1e7a33642b', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'floating_ip_address': '172.27.2.171', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'port_id': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 471, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'mac_address': 'fa:16:3e:0a:41:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:04:39Z', 'updated_at': '2021-08-24T03:04:57Z', 'revision_number': 1, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:49Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:58.474821 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d4413b83-bc8e-4b81-810d-48b21688758e req-d76dfa38-59df-4c2d-995a-5c3335a53d40 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 HTTP/1.1" status: 200 len: 1000 time: 0.0614831 Aug 24 03:04:58.494651 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9ae91b9-8527-44f8-bc2f-ac4fa50c5036 None None] Checking router: 0195ba54-f802-48e9-b0df-bdb173e4aa57 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:04:58.503791 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9ae91b9-8527-44f8-bc2f-ac4fa50c5036 None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:04:58.504332 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-c9ae91b9-8527-44f8-bc2f-ac4fa50c5036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:04:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:58.537462 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4413b83-bc8e-4b81-810d-48b21688758e req-3dfef528-9662-4e0d-88ce-7d3831ce76b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:58.538952 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d4413b83-bc8e-4b81-810d-48b21688758e req-3dfef528-9662-4e0d-88ce-7d3831ce76b5 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=465e9b83-ccde-4ea3-8e80-86590891b03c HTTP/1.1" status: 200 len: 856 time: 0.0493143 Aug 24 03:04:58.596203 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4413b83-bc8e-4b81-810d-48b21688758e req-4c09bfda-6f19-4413-baf8-056bfd41d058 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:58.597755 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d4413b83-bc8e-4b81-810d-48b21688758e req-4c09bfda-6f19-4413-baf8-056bfd41d058 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=72400947-ffa3-49a8-8805-03fdb89d0cfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0458214 Aug 24 03:04:58.614698 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-c9ae91b9-8527-44f8-bc2f-ac4fa50c5036 None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:04:58.690994 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d4413b83-bc8e-4b81-810d-48b21688758e req-2a8bdbb7-b718-4726-97b9-0fbde6e0b5e8 service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832961 Aug 24 03:04:58.785515 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d4413b83-bc8e-4b81-810d-48b21688758e req-50bdd107-b977-4b30-8a1f-2b519dd1d300 service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0855775 Aug 24 03:04:58.842746 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-c9ae91b9-8527-44f8-bc2f-ac4fa50c5036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'b37e0710-3186-4170-9811-0e1e7a33642b', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'floating_ip_address': '172.27.2.171', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'port_id': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 471, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'mac_address': 'fa:16:3e:0a:41:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:04:39Z', 'updated_at': '2021-08-24T03:04:57Z', 'revision_number': 1, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:49Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:04:58.868751 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9ae91b9-8527-44f8-bc2f-ac4fa50c5036 None None] The sync data for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi is: [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'b37e0710-3186-4170-9811-0e1e7a33642b', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'floating_ip_address': '172.27.2.171', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'port_id': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 471, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'mac_address': 'fa:16:3e:0a:41:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:04:39Z', 'updated_at': '2021-08-24T03:04:57Z', 'revision_number': 1, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:49Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:04:59.053073 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0e64da8f-de7e-4438-9ee3-b1ee42c47163 None None] New status for floating IP b37e0710-3186-4170-9811-0e1e7a33642b: ACTIVE {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:04:59.162735 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b036a01-c0bb-42eb-aef4-fb025df25c0b req-0c33491b-6eb7-4d2f-8045-bfe84f111ec3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:59.164368 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1b036a01-c0bb-42eb-aef4-fb025df25c0b req-0c33491b-6eb7-4d2f-8045-bfe84f111ec3 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 946 time: 0.0536339 Aug 24 03:04:59.205698 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1b036a01-c0bb-42eb-aef4-fb025df25c0b req-631ceff1-c16e-4115-bed3-e0c12e9866f0 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0340896 Aug 24 03:04:59.325291 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63243db7-110c-4746-9944-c9f847707ea7 req-d8897133-bbb9-4f4d-8557-d054fc7191d9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:04:59.325291 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-63243db7-110c-4746-9944-c9f847707ea7 req-d8897133-bbb9-4f4d-8557-d054fc7191d9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 946 time: 0.0504529 Aug 24 03:04:59.333838 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38000) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:04:59.338474 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-2a254b46-5f6d-41ec-8091-2fc537773457 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Request body: {'floatingip': {'port_id': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:04:59.377158 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2a254b46-5f6d-41ec-8091-2fc537773457 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:59.813868 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2a254b46-5f6d-41ec-8091-2fc537773457 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:59.873727 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2a254b46-5f6d-41ec-8091-2fc537773457 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:04:59.974087 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.l3_db [None req-2a254b46-5f6d-41ec-8091-2fc537773457 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Floating IP 5d85fa94-91bc-410c-84b9-e7cada0fb8a5 associated. External IP: 172.27.2.57, port: cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3. Aug 24 03:05:00.185856 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2a254b46-5f6d-41ec-8091-2fc537773457 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Router 893a8671-6102-43da-9368-0f66640f4cf7 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:05:00.434004 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e7683b4-7681-44f0-88b4-b779a4ad2525 req-2bf58bbf-980e-4d93-aa3a-46f23379d25e tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:00.435590 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6e7683b4-7681-44f0-88b4-b779a4ad2525 req-2bf58bbf-980e-4d93-aa3a-46f23379d25e tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 946 time: 0.0567896 Aug 24 03:05:00.477936 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6e7683b4-7681-44f0-88b4-b779a4ad2525 req-ed1c38f6-fbf9-487a-a282-8c440ac908d9 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354297 Aug 24 03:05:00.531370 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a254b46-5f6d-41ec-8091-2fc537773457 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:05:00.536098 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2a254b46-5f6d-41ec-8091-2fc537773457 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:00.540428 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc56c3bd-ac70-4e2b-94ee-0cb243fe7ee5 None None] Sync routers for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:05:00.550296 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc56c3bd-ac70-4e2b-94ee-0cb243fe7ee5 None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:05:00.550897 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-dc56c3bd-ac70-4e2b-94ee-0cb243fe7ee5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:04:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:05:00.565201 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-2a254b46-5f6d-41ec-8091-2fc537773457 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "PUT /v2.0/floatingips/5d85fa94-91bc-410c-84b9-e7cada0fb8a5 HTTP/1.1" status: 200 len: 991 time: 1.2301888 Aug 24 03:05:00.565819 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'tag': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:05:00.568128 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1863bca-26b5-48cf-a1a3-54a20932793c" -d '{"events": [{"name": "network-changed", "server_uuid": "18b2a8a2-7207-4a38-a394-1389dfb35117", "tag": "cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:05:00.607228 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:05:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c9692a2-bb19-4b99-813c-65528399722f x-openstack-request-id: req-5c9692a2-bb19-4b99-813c-65528399722f {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:05:00.607521 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "18b2a8a2-7207-4a38-a394-1389dfb35117", "tag": "cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:05:00.607770 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-5c9692a2-bb19-4b99-813c-65528399722f {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:05:00.608158 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'tag': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3', 'status': 'completed', 'code': 200} Aug 24 03:05:00.671110 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-dc56c3bd-ac70-4e2b-94ee-0cb243fe7ee5 None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:05:00.685021 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1863bca-26b5-48cf-a1a3-54a20932793c req-0c38cfc2-d59a-4215-a715-9adaf48448a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:00.686550 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b1863bca-26b5-48cf-a1a3-54a20932793c req-0c38cfc2-d59a-4215-a715-9adaf48448a8 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 1099 time: 0.0453014 Aug 24 03:05:00.790338 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1863bca-26b5-48cf-a1a3-54a20932793c req-6cb3ea02-51c6-4a54-88e6-e7b2059923ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:00.791885 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b1863bca-26b5-48cf-a1a3-54a20932793c req-6cb3ea02-51c6-4a54-88e6-e7b2059923ba service neutron] 10.222.0.43 "GET /v2.0/networks?id=f35e751d-f371-4788-abda-6a58b8a779df HTTP/1.1" status: 200 len: 911 time: 0.0922790 Aug 24 03:05:00.862984 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b1863bca-26b5-48cf-a1a3-54a20932793c req-55e87891-996d-4edb-a613-60612848cbd5 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 HTTP/1.1" status: 200 len: 999 time: 0.0624411 Aug 24 03:05:00.893027 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-dc56c3bd-ac70-4e2b-94ee-0cb243fe7ee5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': '5d85fa94-91bc-410c-84b9-e7cada0fb8a5', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'floating_ip_address': '172.27.2.57', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'port_id': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 472, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'mac_address': 'fa:16:3e:00:32:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:04:40Z', 'updated_at': '2021-08-24T03:04:59Z', 'revision_number': 1, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:43Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:05:00.919900 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1863bca-26b5-48cf-a1a3-54a20932793c req-7f519b6b-befc-4292-96e2-c9f62b501258 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:00.921367 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b1863bca-26b5-48cf-a1a3-54a20932793c req-7f519b6b-befc-4292-96e2-c9f62b501258 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=14102a94-a55b-43e1-a7a9-4210a4c2e2fb HTTP/1.1" status: 200 len: 849 time: 0.0488939 Aug 24 03:05:00.923356 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc56c3bd-ac70-4e2b-94ee-0cb243fe7ee5 None None] Checking router: 893a8671-6102-43da-9368-0f66640f4cf7 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:05:00.931402 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc56c3bd-ac70-4e2b-94ee-0cb243fe7ee5 None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:05:00.931991 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-dc56c3bd-ac70-4e2b-94ee-0cb243fe7ee5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:04:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:05:00.971762 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1863bca-26b5-48cf-a1a3-54a20932793c req-817568ee-322b-42c2-b59f-915538cf2937 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:00.973288 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b1863bca-26b5-48cf-a1a3-54a20932793c req-817568ee-322b-42c2-b59f-915538cf2937 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=f35e751d-f371-4788-abda-6a58b8a779df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0408502 Aug 24 03:05:01.072188 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b1863bca-26b5-48cf-a1a3-54a20932793c req-da32253e-08df-4484-9352-72e6685aef2c service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890863 Aug 24 03:05:01.161988 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-dc56c3bd-ac70-4e2b-94ee-0cb243fe7ee5 None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:05:01.175091 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b1863bca-26b5-48cf-a1a3-54a20932793c req-b15507e6-4823-49e6-a81f-7126f4aab6f3 service neutron] 10.222.0.43 "GET /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0922687 Aug 24 03:05:01.384784 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-dc56c3bd-ac70-4e2b-94ee-0cb243fe7ee5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': '5d85fa94-91bc-410c-84b9-e7cada0fb8a5', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'floating_ip_address': '172.27.2.57', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'port_id': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 472, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'mac_address': 'fa:16:3e:00:32:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:04:40Z', 'updated_at': '2021-08-24T03:04:59Z', 'revision_number': 1, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:43Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:05:01.414254 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc56c3bd-ac70-4e2b-94ee-0cb243fe7ee5 None None] The sync data for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi is: [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': '5d85fa94-91bc-410c-84b9-e7cada0fb8a5', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'floating_ip_address': '172.27.2.57', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'port_id': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 472, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'mac_address': 'fa:16:3e:00:32:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:04:40Z', 'updated_at': '2021-08-24T03:04:59Z', 'revision_number': 1, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:43Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:05:01.609955 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35d32b0a-2619-4033-aae9-40f4c0de9d49 req-d820b4c0-99e6-407b-9a49-bc390baaf421 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:01.609955 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-35d32b0a-2619-4033-aae9-40f4c0de9d49 req-d820b4c0-99e6-407b-9a49-bc390baaf421 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 946 time: 0.0527897 Aug 24 03:05:01.620083 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed3cf04d-2fd4-4163-a96a-75cd3f62fdf8 None None] New status for floating IP 5d85fa94-91bc-410c-84b9-e7cada0fb8a5: ACTIVE {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:05:01.650233 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-35d32b0a-2619-4033-aae9-40f4c0de9d49 req-da6fcb21-e184-4c4b-b408-24e2a9157066 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357087 Aug 24 03:05:02.341027 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fca8caa-c57e-4180-ba2a-43fc357baf37 req-21ce175a-af4e-4c9c-9e91-06ffece8c8bf tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:02.342387 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5fca8caa-c57e-4180-ba2a-43fc357baf37 req-21ce175a-af4e-4c9c-9e91-06ffece8c8bf tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 946 time: 0.0479655 Aug 24 03:05:02.434941 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-5fca8caa-c57e-4180-ba2a-43fc357baf37 req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Deleting port 714fff03-ce7b-45d9-b398-7272d616dd68 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:05:02.435323 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-5fca8caa-c57e-4180-ba2a-43fc357baf37 req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:02.524320 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-5fca8caa-c57e-4180-ba2a-43fc357baf37 req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] For port 714fff03-ce7b-45d9-b398-7272d616dd68, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=714fff03-ce7b-45d9-b398-7272d616dd68,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:05:02.524693 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-5fca8caa-c57e-4180-ba2a-43fc357baf37 req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:02.536879 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-5fca8caa-c57e-4180-ba2a-43fc357baf37 req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Calling delete_port for 714fff03-ce7b-45d9-b398-7272d616dd68 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:05:02.765714 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f20d9a7-3771-4ab2-b824-71214417bc4b req-b9403d54-a481-4ea2-bc25-c5a007827a1d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:02.767166 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6f20d9a7-3771-4ab2-b824-71214417bc4b req-b9403d54-a481-4ea2-bc25-c5a007827a1d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 946 time: 0.0475264 Aug 24 03:05:02.799931 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-5fca8caa-c57e-4180-ba2a-43fc357baf37 req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:02.813170 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['450b43c8-80f4-420a-a8ae-14a79c1f2644', 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d', 'c81e7d9c-7d83-461b-928d-29a453007685', '714fff03-ce7b-45d9-b398-7272d616dd68'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:05:02.832042 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6f20d9a7-3771-4ab2-b824-71214417bc4b req-492df2d9-e8f6-43ed-a07b-2ac2b3bc1904 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589323 Aug 24 03:05:02.836035 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Pushing event deleted for resources: {'Port': ['ID=714fff03-ce7b-45d9-b398-7272d616dd68,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:02.847728 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:02.848082 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:02.848425 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:02.848763 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:02.849098 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:02.849427 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:02.849778 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:02.850111 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:02.850436 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:02.850758 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:02.851080 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:02.851407 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:02.892503 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-5fca8caa-c57e-4180-ba2a-43fc357baf37 req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] No DVR routers for this DVR port 714fff03-ce7b-45d9-b398-7272d616dd68 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:05:02.895075 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-5fca8caa-c57e-4180-ba2a-43fc357baf37 req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:02.897101 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5fca8caa-c57e-4180-ba2a-43fc357baf37 req-43128e27-1990-43cf-9628-a71322b53736 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "DELETE /v2.0/ports/714fff03-ce7b-45d9-b398-7272d616dd68 HTTP/1.1" status: 204 len: 173 time: 0.5486233 Aug 24 03:05:02.897624 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d327609-1228-4ab7-b533-aaa4697437f3', 'name': 'network-vif-deleted', 'tag': '714fff03-ce7b-45d9-b398-7272d616dd68'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:05:02.899923 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7686e65-341f-4cf1-abec-ffeb1b82ad84" -d '{"events": [{"server_uuid": "6d327609-1228-4ab7-b533-aaa4697437f3", "name": "network-vif-deleted", "tag": "714fff03-ce7b-45d9-b398-7272d616dd68"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:05:02.996979 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:05:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-766e4619-8c86-433b-87d1-5c1a50aa9b54 x-openstack-request-id: req-766e4619-8c86-433b-87d1-5c1a50aa9b54 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:05:02.997315 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d327609-1228-4ab7-b533-aaa4697437f3", "name": "network-vif-deleted", "tag": "714fff03-ce7b-45d9-b398-7272d616dd68", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:05:02.997559 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-766e4619-8c86-433b-87d1-5c1a50aa9b54 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:05:02.997942 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d327609-1228-4ab7-b533-aaa4697437f3', 'name': 'network-vif-deleted', 'tag': '714fff03-ce7b-45d9-b398-7272d616dd68', 'status': 'completed', 'code': 200} Aug 24 03:05:03.941635 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9c6ceada-f7ff-4705-a2a1-45f2f5d4f9e8 req-0a47ff6d-1a90-49db-9911-b09de5b80e9d tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=6d327609-1228-4ab7-b533-aaa4697437f3 HTTP/1.1" status: 200 len: 210 time: 0.0275254 Aug 24 03:05:05.692847 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 714fff03-ce7b-45d9-b398-7272d616dd68 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:05:05.713074 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 714fff03-ce7b-45d9-b398-7272d616dd68 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:05:05.713422 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 714fff03-ce7b-45d9-b398-7272d616dd68 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:05:06.848518 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac3324f4-cc3c-49b5-9fd5-97d79d615507 req-5d8cde6a-392a-449b-89fb-45222e3135ec tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:06.849975 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ac3324f4-cc3c-49b5-9fd5-97d79d615507 req-5d8cde6a-392a-449b-89fb-45222e3135ec tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 945 time: 0.0484657 Aug 24 03:05:06.888899 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ac3324f4-cc3c-49b5-9fd5-97d79d615507 req-9fdfc162-c561-4acc-aa12-fcdd720aedbf tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328457 Aug 24 03:05:08.004049 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96aba6c1-a6d7-45ce-b544-0acbb0ebedd8 req-99628188-a603-481b-873f-e9d4efd117a2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:08.005488 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-96aba6c1-a6d7-45ce-b544-0acbb0ebedd8 req-99628188-a603-481b-873f-e9d4efd117a2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 945 time: 0.0482099 Aug 24 03:05:08.042935 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-96aba6c1-a6d7-45ce-b544-0acbb0ebedd8 req-6dd07bd6-9fa6-47bd-8413-aa5a8612a61e tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310221 Aug 24 03:05:08.530612 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e597145-49d8-429c-9b7e-e7178b05fe0b req-79e6464d-879e-4d2e-b626-db9f6082e78c tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:08.532034 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9e597145-49d8-429c-9b7e-e7178b05fe0b req-79e6464d-879e-4d2e-b626-db9f6082e78c tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 945 time: 0.0468855 Aug 24 03:05:08.626427 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-9e597145-49d8-429c-9b7e-e7178b05fe0b req-4b11f811-9cdb-4a4b-b798-3272fa8ec1d0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Deleting port c81e7d9c-7d83-461b-928d-29a453007685 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:05:08.626768 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9e597145-49d8-429c-9b7e-e7178b05fe0b req-4b11f811-9cdb-4a4b-b798-3272fa8ec1d0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:08.633407 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:08.711489 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-9e597145-49d8-429c-9b7e-e7178b05fe0b req-4b11f811-9cdb-4a4b-b798-3272fa8ec1d0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] For port c81e7d9c-7d83-461b-928d-29a453007685, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c81e7d9c-7d83-461b-928d-29a453007685,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:05:08.711849 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9e597145-49d8-429c-9b7e-e7178b05fe0b req-4b11f811-9cdb-4a4b-b798-3272fa8ec1d0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:08.723307 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-9e597145-49d8-429c-9b7e-e7178b05fe0b req-4b11f811-9cdb-4a4b-b798-3272fa8ec1d0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Calling delete_port for c81e7d9c-7d83-461b-928d-29a453007685 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:05:08.957355 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9e597145-49d8-429c-9b7e-e7178b05fe0b req-4b11f811-9cdb-4a4b-b798-3272fa8ec1d0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:08.968575 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['450b43c8-80f4-420a-a8ae-14a79c1f2644', 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d', 'c81e7d9c-7d83-461b-928d-29a453007685'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:05:08.987958 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b11f811-9cdb-4a4b-b798-3272fa8ec1d0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Pushing event deleted for resources: {'Port': ['ID=c81e7d9c-7d83-461b-928d-29a453007685,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:09.028601 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e597145-49d8-429c-9b7e-e7178b05fe0b req-4b11f811-9cdb-4a4b-b798-3272fa8ec1d0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] No DVR routers for this DVR port c81e7d9c-7d83-461b-928d-29a453007685 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:05:09.031606 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9e597145-49d8-429c-9b7e-e7178b05fe0b req-4b11f811-9cdb-4a4b-b798-3272fa8ec1d0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:09.033635 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9e597145-49d8-429c-9b7e-e7178b05fe0b req-4b11f811-9cdb-4a4b-b798-3272fa8ec1d0 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "DELETE /v2.0/ports/c81e7d9c-7d83-461b-928d-29a453007685 HTTP/1.1" status: 204 len: 173 time: 0.4953957 Aug 24 03:05:09.034092 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdec14ec-5b1c-4b55-8e67-d81b5c72d73d', 'name': 'network-vif-deleted', 'tag': 'c81e7d9c-7d83-461b-928d-29a453007685'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:05:09.036415 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d13a4343-b7d8-4b67-9db7-cfd59dc54487" -d '{"events": [{"server_uuid": "fdec14ec-5b1c-4b55-8e67-d81b5c72d73d", "name": "network-vif-deleted", "tag": "c81e7d9c-7d83-461b-928d-29a453007685"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:05:09.085949 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:05:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dca7324a-1dd3-44d5-8ec8-1892a7ef16e3 x-openstack-request-id: req-dca7324a-1dd3-44d5-8ec8-1892a7ef16e3 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:05:09.086351 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdec14ec-5b1c-4b55-8e67-d81b5c72d73d", "name": "network-vif-deleted", "tag": "c81e7d9c-7d83-461b-928d-29a453007685", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:05:09.086672 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-dca7324a-1dd3-44d5-8ec8-1892a7ef16e3 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:05:09.087138 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdec14ec-5b1c-4b55-8e67-d81b5c72d73d', 'name': 'network-vif-deleted', 'tag': 'c81e7d9c-7d83-461b-928d-29a453007685', 'status': 'completed', 'code': 200} Aug 24 03:05:09.159685 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2cd30649-e195-40f9-8c93-091bea9ae27c req-4733a14e-1903-4648-9a67-490bc8ec33e7 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=fdec14ec-5b1c-4b55-8e67-d81b5c72d73d HTTP/1.1" status: 200 len: 210 time: 0.0265946 Aug 24 03:05:10.670310 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91773d06-e1d8-493f-84f1-30ff87019b42 req-f336bb00-26d6-48b3-b63c-b336eda376d5 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:10.671788 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-91773d06-e1d8-493f-84f1-30ff87019b42 req-f336bb00-26d6-48b3-b63c-b336eda376d5 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 946 time: 0.0516620 Aug 24 03:05:10.709114 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-91773d06-e1d8-493f-84f1-30ff87019b42 req-debc4bcc-d047-4c98-afa9-85f58c0a3249 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313830 Aug 24 03:05:11.726400 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device c81e7d9c-7d83-461b-928d-29a453007685 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:05:11.746973 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: c81e7d9c-7d83-461b-928d-29a453007685 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:05:11.747325 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device c81e7d9c-7d83-461b-928d-29a453007685 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:05:11.824639 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-509c795c-60db-41af-b2d2-36bd49ec0a4a req-9b80879d-600e-42e0-b1a4-f289f7586eea tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:11.826021 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-509c795c-60db-41af-b2d2-36bd49ec0a4a req-9b80879d-600e-42e0-b1a4-f289f7586eea tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 946 time: 0.0481577 Aug 24 03:05:11.863706 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-509c795c-60db-41af-b2d2-36bd49ec0a4a req-6275fcb8-e241-4b06-a5f9-bca33e212d44 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318058 Aug 24 03:05:12.279724 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-738dc26e-b3f2-4813-9a38-d7e63c167dc4 req-26187e29-e2b7-416b-8897-a5eba8e1a776 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:12.281133 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-738dc26e-b3f2-4813-9a38-d7e63c167dc4 req-26187e29-e2b7-416b-8897-a5eba8e1a776 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 946 time: 0.0501797 Aug 24 03:05:12.377246 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-738dc26e-b3f2-4813-9a38-d7e63c167dc4 req-6ee57930-9c8a-49fc-9903-3aaa119877cc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Deleting port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:05:12.377618 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-738dc26e-b3f2-4813-9a38-d7e63c167dc4 req-6ee57930-9c8a-49fc-9903-3aaa119877cc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:12.467024 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-738dc26e-b3f2-4813-9a38-d7e63c167dc4 req-6ee57930-9c8a-49fc-9903-3aaa119877cc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] For port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:05:12.467392 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-738dc26e-b3f2-4813-9a38-d7e63c167dc4 req-6ee57930-9c8a-49fc-9903-3aaa119877cc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:12.478877 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-738dc26e-b3f2-4813-9a38-d7e63c167dc4 req-6ee57930-9c8a-49fc-9903-3aaa119877cc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Calling delete_port for c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:05:12.679326 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-738dc26e-b3f2-4813-9a38-d7e63c167dc4 req-6ee57930-9c8a-49fc-9903-3aaa119877cc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:12.693716 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['450b43c8-80f4-420a-a8ae-14a79c1f2644', 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:05:12.712021 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ee57930-9c8a-49fc-9903-3aaa119877cc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Pushing event deleted for resources: {'Port': ['ID=c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:12.752920 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-738dc26e-b3f2-4813-9a38-d7e63c167dc4 req-6ee57930-9c8a-49fc-9903-3aaa119877cc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] No DVR routers for this DVR port c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:05:12.755891 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-738dc26e-b3f2-4813-9a38-d7e63c167dc4 req-6ee57930-9c8a-49fc-9903-3aaa119877cc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:12.758072 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-738dc26e-b3f2-4813-9a38-d7e63c167dc4 req-6ee57930-9c8a-49fc-9903-3aaa119877cc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "DELETE /v2.0/ports/c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d HTTP/1.1" status: 204 len: 173 time: 0.4653945 Aug 24 03:05:12.758485 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62e2db1f-a628-41d4-bc7a-eed2965da9d4', 'name': 'network-vif-deleted', 'tag': 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:05:12.760881 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-03f7d2a4-20f6-45f1-8e38-991bc8d6fc2c" -d '{"events": [{"server_uuid": "62e2db1f-a628-41d4-bc7a-eed2965da9d4", "name": "network-vif-deleted", "tag": "c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:05:12.799268 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:05:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-93fe4b55-49de-469d-8a79-f4ea28834fe4 x-openstack-request-id: req-93fe4b55-49de-469d-8a79-f4ea28834fe4 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:05:12.799560 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "62e2db1f-a628-41d4-bc7a-eed2965da9d4", "name": "network-vif-deleted", "tag": "c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:05:12.799811 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-93fe4b55-49de-469d-8a79-f4ea28834fe4 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:05:12.800200 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '62e2db1f-a628-41d4-bc7a-eed2965da9d4', 'name': 'network-vif-deleted', 'tag': 'c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d', 'status': 'completed', 'code': 200} Aug 24 03:05:12.961151 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-77c7c4b5-e3ed-4c6b-acce-2cb8f7027932 req-ff02b7ce-3883-4307-91ee-f7353a08402e tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=62e2db1f-a628-41d4-bc7a-eed2965da9d4 HTTP/1.1" status: 200 len: 210 time: 0.0259593 Aug 24 03:05:15.568751 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:05:15.724482 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:05:15.744514 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:05:15.744851 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device c0966ea3-1bcd-4c3b-b240-7e72d9fd8f1d not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:05:15.857418 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c59957-7971-45b0-8236-aee607b6b537 req-dcd13d93-d891-476b-8506-329a4ef45563 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:15.859718 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-46c59957-7971-45b0-8236-aee607b6b537 req-dcd13d93-d891-476b-8506-329a4ef45563 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 945 time: 0.0541193 Aug 24 03:05:15.898248 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-46c59957-7971-45b0-8236-aee607b6b537 req-cc0ba792-1587-4084-9fc9-7b736edc39dc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314946 Aug 24 03:05:17.015092 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-927d7bf5-e563-41b4-ba44-26787694d2b4 req-4fefeaac-07cd-4155-bd1c-95b426055abc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:17.016576 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-927d7bf5-e563-41b4-ba44-26787694d2b4 req-4fefeaac-07cd-4155-bd1c-95b426055abc tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 945 time: 0.0487499 Aug 24 03:05:17.054884 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-927d7bf5-e563-41b4-ba44-26787694d2b4 req-095517d6-8238-401a-ac63-b7ccb1758cd6 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323570 Aug 24 03:05:17.821075 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce04463d-f489-451e-bcc1-cc9f0243de11 req-badadd51-ea6d-4ccd-9890-d91230b651af tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:17.822510 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ce04463d-f489-451e-bcc1-cc9f0243de11 req-badadd51-ea6d-4ccd-9890-d91230b651af tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 945 time: 0.0492361 Aug 24 03:05:17.916968 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-ce04463d-f489-451e-bcc1-cc9f0243de11 req-91579e71-774a-4e8a-b5a4-94669bdd94a2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Deleting port 450b43c8-80f4-420a-a8ae-14a79c1f2644 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:05:17.917094 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-ce04463d-f489-451e-bcc1-cc9f0243de11 req-91579e71-774a-4e8a-b5a4-94669bdd94a2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:18.004976 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-ce04463d-f489-451e-bcc1-cc9f0243de11 req-91579e71-774a-4e8a-b5a4-94669bdd94a2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] For port 450b43c8-80f4-420a-a8ae-14a79c1f2644, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=450b43c8-80f4-420a-a8ae-14a79c1f2644,segment=NetworkSegment(265560af-a3e0-4c25-85a0-de528164f111),segment_id=265560af-a3e0-4c25-85a0-de528164f111)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:05:18.005339 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-ce04463d-f489-451e-bcc1-cc9f0243de11 req-91579e71-774a-4e8a-b5a4-94669bdd94a2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:18.016892 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-ce04463d-f489-451e-bcc1-cc9f0243de11 req-91579e71-774a-4e8a-b5a4-94669bdd94a2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Calling delete_port for 450b43c8-80f4-420a-a8ae-14a79c1f2644 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:05:18.170683 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c9b78f-d49b-4548-808c-c97e0c93d407 req-51a43e2e-2e66-44d6-b8c4-9d1db618896b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:18.172079 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-94c9b78f-d49b-4548-808c-c97e0c93d407 req-51a43e2e-2e66-44d6-b8c4-9d1db618896b tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 945 time: 0.0490739 Aug 24 03:05:18.208715 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-94c9b78f-d49b-4548-808c-c97e0c93d407 req-207cc1fb-655e-443f-800d-ea0274432c24 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/security-groups?id=c016b3ff-8807-4c30-acdd-3519191539dd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308154 Aug 24 03:05:18.284835 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-ce04463d-f489-451e-bcc1-cc9f0243de11 req-91579e71-774a-4e8a-b5a4-94669bdd94a2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:18.296422 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['450b43c8-80f4-420a-a8ae-14a79c1f2644'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:05:18.316660 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91579e71-774a-4e8a-b5a4-94669bdd94a2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Pushing event deleted for resources: {'Port': ['ID=450b43c8-80f4-420a-a8ae-14a79c1f2644,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:18.355757 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-ce04463d-f489-451e-bcc1-cc9f0243de11 req-91579e71-774a-4e8a-b5a4-94669bdd94a2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] No DVR routers for this DVR port 450b43c8-80f4-420a-a8ae-14a79c1f2644 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:05:18.358272 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-ce04463d-f489-451e-bcc1-cc9f0243de11 req-91579e71-774a-4e8a-b5a4-94669bdd94a2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:18.360319 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ce04463d-f489-451e-bcc1-cc9f0243de11 req-91579e71-774a-4e8a-b5a4-94669bdd94a2 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.43 "DELETE /v2.0/ports/450b43c8-80f4-420a-a8ae-14a79c1f2644 HTTP/1.1" status: 204 len: 173 time: 0.5303032 Aug 24 03:05:18.360750 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c1b52e4a-a25e-48b6-a970-280f7ae198b7', 'name': 'network-vif-deleted', 'tag': '450b43c8-80f4-420a-a8ae-14a79c1f2644'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:05:18.363029 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e22b0347-8695-4395-b2f0-4094139e84e5" -d '{"events": [{"server_uuid": "c1b52e4a-a25e-48b6-a970-280f7ae198b7", "name": "network-vif-deleted", "tag": "450b43c8-80f4-420a-a8ae-14a79c1f2644"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:05:18.398438 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:05:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-65a6f37e-02a5-4da2-9663-cc320b2120a8 x-openstack-request-id: req-65a6f37e-02a5-4da2-9663-cc320b2120a8 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:05:18.398721 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c1b52e4a-a25e-48b6-a970-280f7ae198b7", "name": "network-vif-deleted", "tag": "450b43c8-80f4-420a-a8ae-14a79c1f2644", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:05:18.398971 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-65a6f37e-02a5-4da2-9663-cc320b2120a8 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:05:18.399359 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c1b52e4a-a25e-48b6-a970-280f7ae198b7', 'name': 'network-vif-deleted', 'tag': '450b43c8-80f4-420a-a8ae-14a79c1f2644', 'status': 'completed', 'code': 200} Aug 24 03:05:19.321483 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fdfb559b-db1c-42a0-9ad2-5c323c56a772 req-325d8916-3f72-4111-9fa2-b67ff7dc5e07 tempest-AttachVolumeNegativeTest-1664068947 tempest-AttachVolumeNegativeTest-1664068947-project] 10.222.0.30 "GET /v2.0/ports?device_id=c1b52e4a-a25e-48b6-a970-280f7ae198b7 HTTP/1.1" status: 200 len: 210 time: 0.0291302 Aug 24 03:05:20.375954 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38154) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:20.419194 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-7ae54d15-4a68-45b4-9ebd-c72040459043 admin admin] Deleting subnet 05cef140-037d-459e-a03d-a6915273f9d4 {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:05:20.422163 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7ae54d15-4a68-45b4-9ebd-c72040459043 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:20.455747 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7ae54d15-4a68-45b4-9ebd-c72040459043 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:20.493182 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7ae54d15-4a68-45b4-9ebd-c72040459043 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:20.627713 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7ae54d15-4a68-45b4-9ebd-c72040459043 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:20.653432 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ae54d15-4a68-45b4-9ebd-c72040459043 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=05cef140-037d-459e-a03d-a6915273f9d4,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:20.658531 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7ae54d15-4a68-45b4-9ebd-c72040459043 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:20.660541 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-7ae54d15-4a68-45b4-9ebd-c72040459043 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/05cef140-037d-459e-a03d-a6915273f9d4 HTTP/1.1" status: 204 len: 168 time: 0.2834649 Aug 24 03:05:20.662938 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38156) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:20.757332 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:20.843276 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:20.853276 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a8a02a2d-c194-4f2f-9653-b6e128589efc']}} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:05:20.866695 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '265560af-a3e0-4c25-85a0-de528164f111') {'for_net_delete': True} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:05:20.866999 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '265560af-a3e0-4c25-85a0-de528164f111') {} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:05:20.878506 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25719248'] for segment, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:20.892488 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:20.898890 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] Releasing vlan 382 on physical network physnet1 to pool {{(pid=111275) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3484247'] for segment, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: Traceback (most recent call last): Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: timer() Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: cb(*args, **kw) Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: return func(*args, **kwargs) Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: self._notify() Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: self.callback(batched_events) Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: event.method(event) Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: return f(self, *a, **k) Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._get(url).json() Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: return self.request(url, 'GET', **kwargs) Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:05:20.901798 dv-cinder-803748-8-iscsi neutron-server[111275]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:05:21.033138 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:21.038572 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:21.040336 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] 10.222.0.30 "DELETE /v2.0/networks/a8a02a2d-c194-4f2f-9653-b6e128589efc HTTP/1.1" status: 204 len: 168 time: 0.3764334 Aug 24 03:05:21.051452 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abca72b4-3d18-4aac-adde-fb069adff03b admin admin] Pushing event deleted for resources: {'Network': ['ID=a8a02a2d-c194-4f2f-9653-b6e128589efc,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:21.387910 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-39b43e3f-51be-4680-8c3e-34404c2e3c47 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:21.468222 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38164) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:21.510389 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-b3e2790a-db58-4636-956b-dbe1c585a160 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=18e124ea63a5483aba6b8f112a4d4b33&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0410364 Aug 24 03:05:21.513766 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38166) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:21.572470 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7f3c260b-9214-4b28-994c-8ed1cea80b75 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:21.596951 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7f3c260b-9214-4b28-994c-8ed1cea80b75 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:21.724723 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7f3c260b-9214-4b28-994c-8ed1cea80b75 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:21.727191 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7f3c260b-9214-4b28-994c-8ed1cea80b75 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:21.728348 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-7f3c260b-9214-4b28-994c-8ed1cea80b75 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c016b3ff-8807-4c30-acdd-3519191539dd HTTP/1.1" status: 204 len: 168 time: 0.2137101 Aug 24 03:05:21.736648 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f3c260b-9214-4b28-994c-8ed1cea80b75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c016b3ff-8807-4c30-acdd-3519191539dd,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:21.813125 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 450b43c8-80f4-420a-a8ae-14a79c1f2644 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:05:21.832274 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 450b43c8-80f4-420a-a8ae-14a79c1f2644 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:05:21.832616 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 450b43c8-80f4-420a-a8ae-14a79c1f2644 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:05:23.958603 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-393c4236-45ac-4ea0-ba06-3c4702066de4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:24.351790 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:25.570059 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:26.953006 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:34.863652 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c95edf47-bf83-4e7c-b533-e88d4564cd85 req-a6eaa9cb-42b3-4ac0-9c15-4cabe972fc30 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:34.865182 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c95edf47-bf83-4e7c-b533-e88d4564cd85 req-a6eaa9cb-42b3-4ac0-9c15-4cabe972fc30 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0496280 Aug 24 03:05:34.901883 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c95edf47-bf83-4e7c-b533-e88d4564cd85 req-3ac09078-2c04-4251-8c14-02e1fafe4639 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309029 Aug 24 03:05:35.917162 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 38354) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:36.030817 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d33d41-e2aa-481b-be15-c4e51464e0aa req-afc43b0c-324e-4920-bcb0-1fe0b13b8d91 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:36.032354 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f4d33d41-e2aa-481b-be15-c4e51464e0aa req-afc43b0c-324e-4920-bcb0-1fe0b13b8d91 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0602720 Aug 24 03:05:36.033469 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af2acbcc-aeca-4d1d-a397-95ea3cbf6650 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:36.094671 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f4d33d41-e2aa-481b-be15-c4e51464e0aa req-0fec82a9-8ba7-409d-871b-db288fa9759d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535820 Aug 24 03:05:36.154535 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af2acbcc-aeca-4d1d-a397-95ea3cbf6650 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:36.255459 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af2acbcc-aeca-4d1d-a397-95ea3cbf6650 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:36.294050 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-af2acbcc-aeca-4d1d-a397-95ea3cbf6650 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=4ba96238ced944cdb18734df44428829&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3755541 Aug 24 03:05:36.294992 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af2acbcc-aeca-4d1d-a397-95ea3cbf6650 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e64fa909-fcbe-4108-882a-2a3dac716905,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:36.296770 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38360) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:36.346145 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:36.369218 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:36.484191 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:36.486823 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:36.490591 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e64fa909-fcbe-4108-882a-2a3dac716905 HTTP/1.1" status: 204 len: 168 time: 0.1928298 Aug 24 03:05:36.499200 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e64fa909-fcbe-4108-882a-2a3dac716905,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:36.506512 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:36.507070 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:36.507428 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:36.507773 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:36.508222 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:36.508561 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:36.508887 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:36.509430 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:36.509705 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:36.510030 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:36.510356 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:36.510677 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e8ba157-b0a5-484a-acca-8d81ff2c0a52 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:36.518293 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-89d0d88b-adba-453a-a7c0-b08de8f3f00f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:36.519829 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-89d0d88b-adba-453a-a7c0-b08de8f3f00f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0550065 Aug 24 03:05:36.873943 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Deleting port 894657b8-22e4-4340-af94-46bb6d84e3d7 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:05:36.876958 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:36.958530 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] For port 894657b8-22e4-4340-af94-46bb6d84e3d7, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=894657b8-22e4-4340-af94-46bb6d84e3d7,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:05:36.959187 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:37.133821 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:37.134138 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:37.134595 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.l3_db [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Floating IP 8bd3ec8e-9712-4a9c-96d2-64724391335a disassociated. External IP: 172.27.2.38, port: 894657b8-22e4-4340-af94-46bb6d84e3d7. Aug 24 03:05:37.134944 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Calling delete_port for 894657b8-22e4-4340-af94-46bb6d84e3d7 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:05:37.164044 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38372) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:37.190444 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a2f149b6-7774-4404-81ab-757777ff1cff admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:37.247082 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7948992c-d9e0-4c45-a040-ca22cedf4fd5 req-94afeaae-a168-40c1-8fdd-f3866ffe399c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:37.248640 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7948992c-d9e0-4c45-a040-ca22cedf4fd5 req-94afeaae-a168-40c1-8fdd-f3866ffe399c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 945 time: 0.0757928 Aug 24 03:05:37.304148 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7948992c-d9e0-4c45-a040-ca22cedf4fd5 req-14d2d1c9-a950-47a3-9e95-3ce82ee555b8 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463381 Aug 24 03:05:37.330730 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:37.344188 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a2f149b6-7774-4404-81ab-757777ff1cff admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:37.361064 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event deleted for resources: {'Port': ['ID=894657b8-22e4-4340-af94-46bb6d84e3d7,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:37.432622 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a2f149b6-7774-4404-81ab-757777ff1cff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:37.474813 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a2f149b6-7774-4404-81ab-757777ff1cff admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=e7cd8d8a6f184bc7936a112bc33e20b8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3095477 Aug 24 03:05:37.475920 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2f149b6-7774-4404-81ab-757777ff1cff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc8a8167-4a1e-4dfb-b53b-eb8ff3cd06fe,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:37.478201 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38374) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:37.482022 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:05:37.533619 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c79ff8b4-c358-4dd3-bd46-ae0e5e091d28 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:37.559126 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c79ff8b4-c358-4dd3-bd46-ae0e5e091d28 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:37.598613 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:05:37.608297 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3bd0e8f9-697c-4722-9db6-811218292df9 None None] Sync routers for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:05:37.617458 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3bd0e8f9-697c-4722-9db6-811218292df9 None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:05:37.618101 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-3bd0e8f9-697c-4722-9db6-811218292df9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:05:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:05:37.647301 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] No DVR routers for this DVR port 894657b8-22e4-4340-af94-46bb6d84e3d7 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:05:37.649866 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:37.651888 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-33ea7962-f48c-4245-b8e8-58b01aefbc0e req-663afdd2-2b3a-4062-a582-f6ae57fe2a0e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "DELETE /v2.0/ports/894657b8-22e4-4340-af94-46bb6d84e3d7 HTTP/1.1" status: 204 len: 173 time: 1.1151252 Aug 24 03:05:37.652325 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'name': 'network-vif-deleted', 'tag': '894657b8-22e4-4340-af94-46bb6d84e3d7'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:05:37.654800 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9de7aa66-2757-4c46-9c40-485b5f769f9c" -d '{"events": [{"server_uuid": "07edef45-7d42-46a0-89b8-2a6e24a64a16", "name": "network-vif-deleted", "tag": "894657b8-22e4-4340-af94-46bb6d84e3d7"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:05:37.693785 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:05:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e9840faf-74e5-4156-abce-8344546c5c90 x-openstack-request-id: req-e9840faf-74e5-4156-abce-8344546c5c90 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:05:37.694219 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "07edef45-7d42-46a0-89b8-2a6e24a64a16", "name": "network-vif-deleted", "tag": "894657b8-22e4-4340-af94-46bb6d84e3d7", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:05:37.694476 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e9840faf-74e5-4156-abce-8344546c5c90 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:05:37.694915 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '07edef45-7d42-46a0-89b8-2a6e24a64a16', 'name': 'network-vif-deleted', 'tag': '894657b8-22e4-4340-af94-46bb6d84e3d7', 'status': 'completed', 'code': 200} Aug 24 03:05:37.705654 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c79ff8b4-c358-4dd3-bd46-ae0e5e091d28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:37.711754 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c79ff8b4-c358-4dd3-bd46-ae0e5e091d28 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:37.711754 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-c79ff8b4-c358-4dd3-bd46-ae0e5e091d28 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/fc8a8167-4a1e-4dfb-b53b-eb8ff3cd06fe HTTP/1.1" status: 204 len: 168 time: 0.2305360 Aug 24 03:05:37.718702 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c79ff8b4-c358-4dd3-bd46-ae0e5e091d28 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc8a8167-4a1e-4dfb-b53b-eb8ff3cd06fe,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:37.741291 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-3bd0e8f9-697c-4722-9db6-811218292df9 None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:05:37.953459 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-3bd0e8f9-697c-4722-9db6-811218292df9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:05:37.978483 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3bd0e8f9-697c-4722-9db6-811218292df9 None None] Checking router: 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:05:37.987218 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3bd0e8f9-697c-4722-9db6-811218292df9 None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:05:37.987817 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-3bd0e8f9-697c-4722-9db6-811218292df9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:05:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:05:38.099108 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-3bd0e8f9-697c-4722-9db6-811218292df9 None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:05:38.295721 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-3bd0e8f9-697c-4722-9db6-811218292df9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:05:38.322600 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3bd0e8f9-697c-4722-9db6-811218292df9 None None] The sync data for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi is: [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:05:38.415678 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6c37db02-2ab3-4bca-9375-e4a90b44be78 req-7b1f2b8d-8bb6-41db-9e13-92f90bbe8adc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=07edef45-7d42-46a0-89b8-2a6e24a64a16 HTTP/1.1" status: 200 len: 210 time: 0.0270195 Aug 24 03:05:38.530080 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38388) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:38.537239 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b940c7a-caac-4c2e-ae79-acf46aff6328 None None] New status for floating IP 8bd3ec8e-9712-4a9c-96d2-64724391335a: DOWN {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:05:38.545472 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-911cc35c-22dd-4857-bda8-77cbfe8db209 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:38.604022 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:38.634595 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-911cc35c-22dd-4857-bda8-77cbfe8db209 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:38.724228 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-911cc35c-22dd-4857-bda8-77cbfe8db209 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:38.769832 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-911cc35c-22dd-4857-bda8-77cbfe8db209 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=0cba60e37c1c4aac8e99023c1e1cb0db&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2361488 Aug 24 03:05:38.769832 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911cc35c-22dd-4857-bda8-77cbfe8db209 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae0dab25-87ff-4d9d-906a-96b1b53883f8,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:38.770217 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 38392) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:38.822927 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8faa277f-ec6e-450b-a556-03cfe82c0a4f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:38.843687 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8faa277f-ec6e-450b-a556-03cfe82c0a4f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:38.954127 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8faa277f-ec6e-450b-a556-03cfe82c0a4f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:38.956613 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8faa277f-ec6e-450b-a556-03cfe82c0a4f admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:38.957752 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-8faa277f-ec6e-450b-a556-03cfe82c0a4f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ae0dab25-87ff-4d9d-906a-96b1b53883f8 HTTP/1.1" status: 204 len: 168 time: 0.1865745 Aug 24 03:05:38.969658 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8faa277f-ec6e-450b-a556-03cfe82c0a4f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae0dab25-87ff-4d9d-906a-96b1b53883f8,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:38.976009 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f9f319d8-9df9-4eb4-8097-9ecc21471364 req-8daad660-62d9-446e-bea6-f857e661a19c service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0519092 Aug 24 03:05:39.053198 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f319d8-9df9-4eb4-8097-9ecc21471364 req-39cf2dc0-afd9-4143-8dc7-4c70ea18da65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:39.054733 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f9f319d8-9df9-4eb4-8097-9ecc21471364 req-39cf2dc0-afd9-4143-8dc7-4c70ea18da65 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=8bca2ab0549a4f099c2421571c26f61b&device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 1098 time: 0.0474465 Aug 24 03:05:39.157234 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f319d8-9df9-4eb4-8097-9ecc21471364 req-c56c4870-b571-4945-b190-7d216cbdd0f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:39.158765 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f9f319d8-9df9-4eb4-8097-9ecc21471364 req-c56c4870-b571-4945-b190-7d216cbdd0f6 service neutron] 10.222.0.43 "GET /v2.0/networks?id=866d4604-551e-4da3-b89c-967338dbafff HTTP/1.1" status: 200 len: 910 time: 0.0848534 Aug 24 03:05:39.227527 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f9f319d8-9df9-4eb4-8097-9ecc21471364 req-d2d5ad11-8afe-4f44-b9b3-5de0a305b0ae service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09 HTTP/1.1" status: 200 len: 1001 time: 0.0617576 Aug 24 03:05:39.274884 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f319d8-9df9-4eb4-8097-9ecc21471364 req-89815e9e-d844-48f8-bdae-0c21db43c0e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:39.276263 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f9f319d8-9df9-4eb4-8097-9ecc21471364 req-89815e9e-d844-48f8-bdae-0c21db43c0e3 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4ffb6451-69cb-476e-bc2e-5b6165a067b1 HTTP/1.1" status: 200 len: 848 time: 0.0418322 Aug 24 03:05:39.324200 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f319d8-9df9-4eb4-8097-9ecc21471364 req-cc20368b-13cc-4b3e-b2ae-13c3f9ddb9c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:39.328530 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f9f319d8-9df9-4eb4-8097-9ecc21471364 req-cc20368b-13cc-4b3e-b2ae-13c3f9ddb9c4 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=866d4604-551e-4da3-b89c-967338dbafff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0413907 Aug 24 03:05:39.422138 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f9f319d8-9df9-4eb4-8097-9ecc21471364 req-ee94e122-c928-48ff-9519-7aad8be81a6f service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0885594 Aug 24 03:05:39.530960 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f9f319d8-9df9-4eb4-8097-9ecc21471364 req-a8b97db4-fb5c-45d4-8216-3b0eec76cd7a service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1013143 Aug 24 03:05:39.692358 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-c70bc583-420e-422c-8015-7d60475b1d88 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1453650260&fields=id&tenant_id=03198f839b864099b1c011c0fc54c7dd HTTP/1.1" status: 200 len: 267 time: 0.0363269 Aug 24 03:05:39.808964 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-bd1a764e-09df-4362-aff4-fef9d07b7b55 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:39.812527 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-bd1a764e-09df-4362-aff4-fef9d07b7b55 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 812 time: 0.1110861 Aug 24 03:05:39.826887 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-3098d733-8634-413d-b83f-0240a506101d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/quotas/03198f839b864099b1c011c0fc54c7dd HTTP/1.1" status: 200 len: 375 time: 0.0101655 Aug 24 03:05:39.884157 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-ba235614-35c3-4644-a76c-a441966cf33d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0518467 Aug 24 03:05:39.895627 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 894657b8-22e4-4340-af94-46bb6d84e3d7 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:05:39.915933 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 894657b8-22e4-4340-af94-46bb6d84e3d7 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:05:39.916298 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 894657b8-22e4-4340-af94-46bb6d84e3d7 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:05:39.979424 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-bc1d11ba-d170-4bc7-a152-82ac45b80c2f service neutron] 10.222.0.30 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830252 Aug 24 03:05:40.080973 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-af9d2a87-c30e-4fcf-9609-c684797816c1 service neutron] 10.222.0.30 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0947518 Aug 24 03:05:40.691046 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fbfa4f4d-d85f-4780-86d0-5c4480b99016 req-f20ab179-95ae-48b5-9390-35a78f03cb3a tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 210 time: 0.0311885 Aug 24 03:05:41.789716 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e83db0b7-57bc-4d33-9a9c-9112899b845c req-1727c6cf-ab3f-4f65-ac49-c2088a8b0c58 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 210 time: 0.0271790 Aug 24 03:05:42.884220 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-db0c2e2a-d644-450e-adf9-6598e0d1f94b req-e19cd0e0-d730-4f76-a4eb-50528301c062 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 210 time: 0.0256283 Aug 24 03:05:42.971159 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-af3bf106-038e-4705-b881-fb7649a912ce tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:42.972595 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-af3bf106-038e-4705-b881-fb7649a912ce tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 812 time: 0.1193397 Aug 24 03:05:43.018267 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-66fcb6dc-3ee1-47ec-8c62-b4611a343328 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=03198f839b864099b1c011c0fc54c7dd HTTP/1.1" status: 200 len: 380 time: 0.0359383 Aug 24 03:05:43.029015 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'port': {'device_id': '5b446c10-d1d6-4e68-959c-417655d2070b', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'admin_state_up': True, 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'security_groups': ['b69cad14-2388-40cc-8cc6-0b7d617b183d']}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:05:43.238324 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Made reservation on behalf of 03198f839b864099b1c011c0fc54c7dd for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:05:43.241931 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:43.372418 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Allocated IP 172.20.0.3 (3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6/9d24a59e-1441-41fd-b523-3368836ed9c4/a8f7945f-96cc-40aa-897c-b9f7dd88be75) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:05:43.510980 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:43.525308 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Transition to ACTIVE for port object a8f7945f-96cc-40aa-897c-b9f7dd88be75 will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:05:43.690132 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:43.746133 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:05:43.749758 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:05:43.756691 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:05:43.759299 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'Port': ['ID=a8f7945f-96cc-40aa-897c-b9f7dd88be75,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:43.810170 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:43.812600 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:43.948154 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-1c0d78e1-b435-4378-9b71-15c8102a3bdc tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9237669 Aug 24 03:05:43.960333 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Request body: {'port': {'device_id': '5b446c10-d1d6-4e68-959c-417655d2070b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:05:44.045966 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:44.063598 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2474ea57-82ce-4ee4-a715-a305f253210a req-fffa209e-0a27-4b93-9279-9ab86fea2cf4 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:44.065069 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2474ea57-82ce-4ee4-a715-a305f253210a req-fffa209e-0a27-4b93-9279-9ab86fea2cf4 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 931 time: 0.1018472 Aug 24 03:05:44.101485 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-dae06c3e-c3ee-44d6-8d23-6a5195fab400 None None] Provisioning for port a8f7945f-96cc-40aa-897c-b9f7dd88be75 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:05:44.109605 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-dae06c3e-c3ee-44d6-8d23-6a5195fab400 None None] Provisioning complete for port a8f7945f-96cc-40aa-897c-b9f7dd88be75 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:05:44.110071 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-dae06c3e-c3ee-44d6-8d23-6a5195fab400 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:44.134211 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2474ea57-82ce-4ee4-a715-a305f253210a req-28e248a5-136b-4bf5-819e-d900c5926c20 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0629385 Aug 24 03:05:44.168873 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-dae06c3e-c3ee-44d6-8d23-6a5195fab400 None None] Port a8f7945f-96cc-40aa-897c-b9f7dd88be75 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:05:44.348823 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a8f7945f-96cc-40aa-897c-b9f7dd88be75 {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:05:44.357380 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:44.369479 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Transition to ACTIVE for port object a8f7945f-96cc-40aa-897c-b9f7dd88be75 will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:05:44.506824 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:44.562466 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Pushing event updated for resources: {'Port': ['ID=a8f7945f-96cc-40aa-897c-b9f7dd88be75,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:44.631720 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Attempting to bind port a8f7945f-96cc-40aa-897c-b9f7dd88be75 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:05:44.632356 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Attempting to bind port a8f7945f-96cc-40aa-897c-b9f7dd88be75 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:05:44.632493 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Attempting to bind port a8f7945f-96cc-40aa-897c-b9f7dd88be75 on network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:05:44.643144 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Port a8f7945f-96cc-40aa-897c-b9f7dd88be75 on network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:05:44.648934 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Attempting to bind port a8f7945f-96cc-40aa-897c-b9f7dd88be75 on network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:05:44.649657 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 5, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:05:44.651608 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Checking segment: {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:05:44.652620 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Bound using segment: {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:05:44.653292 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Bound port: a8f7945f-96cc-40aa-897c-b9f7dd88be75, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:05:44.653683 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:44.724506 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] For port a8f7945f-96cc-40aa-897c-b9f7dd88be75, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:05:44.727468 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] For port a8f7945f-96cc-40aa-897c-b9f7dd88be75, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=a8f7945f-96cc-40aa-897c-b9f7dd88be75,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:05:44.821721 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:44.855967 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:44.856668 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:44.858093 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] 10.222.0.43 "PUT /v2.0/ports/a8f7945f-96cc-40aa-897c-b9f7dd88be75 HTTP/1.1" status: 200 len: 1093 time: 0.9021392 Aug 24 03:05:44.858564 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5b446c10-d1d6-4e68-959c-417655d2070b', 'tag': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:05:44.860837 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b32b8e6a-641d-4376-98b7-d70c93e86293" -d '{"events": [{"name": "network-changed", "server_uuid": "5b446c10-d1d6-4e68-959c-417655d2070b", "tag": "a8f7945f-96cc-40aa-897c-b9f7dd88be75"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:05:44.909372 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:05:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95cfb8e9-2bb6-4b73-8aa7-ff6bffad5f8c x-openstack-request-id: req-95cfb8e9-2bb6-4b73-8aa7-ff6bffad5f8c {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:05:44.909372 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5b446c10-d1d6-4e68-959c-417655d2070b", "tag": "a8f7945f-96cc-40aa-897c-b9f7dd88be75", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:05:44.909372 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-95cfb8e9-2bb6-4b73-8aa7-ff6bffad5f8c {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:05:44.909372 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5b446c10-d1d6-4e68-959c-417655d2070b', 'tag': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'status': 'completed', 'code': 200} Aug 24 03:05:44.914087 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11d175f8-db80-4330-a150-99f5d0f96a5c service neutron] Pushing event updated for resources: {'Port': ['ID=a8f7945f-96cc-40aa-897c-b9f7dd88be75,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:44.971022 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32b8e6a-641d-4376-98b7-d70c93e86293 req-adccf2cb-0e91-4bb0-b2d7-43ea8a948d82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:44.972536 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b32b8e6a-641d-4376-98b7-d70c93e86293 req-adccf2cb-0e91-4bb0-b2d7-43ea8a948d82 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 1096 time: 0.0471914 Aug 24 03:05:45.086529 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32b8e6a-641d-4376-98b7-d70c93e86293 req-e011f794-d219-4f9f-b8d2-1d09dd7ba076 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:45.086529 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b32b8e6a-641d-4376-98b7-d70c93e86293 req-e011f794-d219-4f9f-b8d2-1d09dd7ba076 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=03198f839b864099b1c011c0fc54c7dd&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1050360 Aug 24 03:05:45.182624 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32b8e6a-641d-4376-98b7-d70c93e86293 req-a6ef5e34-6d17-4e1f-b55f-79928998d5bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:45.184247 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b32b8e6a-641d-4376-98b7-d70c93e86293 req-a6ef5e34-6d17-4e1f-b55f-79928998d5bd service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0905321 Aug 24 03:05:45.295669 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-68043403-da3f-46e3-a231-599eb5741ff0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:45.297194 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-68043403-da3f-46e3-a231-599eb5741ff0 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 1096 time: 0.0745437 Aug 24 03:05:45.304455 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6971a3ee-adf9-44db-8095-e269b7c3f118 req-4dd40d7f-c91d-443b-8bd3-7028b418a999 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:45.305839 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6971a3ee-adf9-44db-8095-e269b7c3f118 req-4dd40d7f-c91d-443b-8bd3-7028b418a999 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 943 time: 0.0819814 Aug 24 03:05:45.344651 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-f87f7813-06d2-400d-8809-a1bafce64000 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a8f7945f-96cc-40aa-897c-b9f7dd88be75 HTTP/1.1" status: 200 len: 217 time: 0.0377970 Aug 24 03:05:45.409824 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6971a3ee-adf9-44db-8095-e269b7c3f118 req-bef5ab71-87a8-447d-9c44-5b3549835e48 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0678382 Aug 24 03:05:45.417131 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-9e9ca1fc-269f-45df-9306-62f4d46b1e67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:45.418986 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-9e9ca1fc-269f-45df-9306-62f4d46b1e67 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 200 len: 851 time: 0.0627873 Aug 24 03:05:45.472781 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-f6c2771c-2618-43cc-98e8-42f0e36fcd02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:45.474377 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-f6c2771c-2618-43cc-98e8-42f0e36fcd02 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0477381 Aug 24 03:05:45.573142 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-e5748a57-790b-4cee-8ad1-d8bc92bf5953 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0911326 Aug 24 03:05:45.673477 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-60d7d2f5-964f-4205-8af5-9d555301d6a3 req-0a554db3-f190-4e6e-8609-ad153de97d25 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0926774 Aug 24 03:05:45.673722 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e13420de-c51a-402f-82fb-57fd04cc2ef0 req-823e6bc4-c333-4339-95ed-b74c5c1e78b0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:45.675032 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e13420de-c51a-402f-82fb-57fd04cc2ef0 req-823e6bc4-c333-4339-95ed-b74c5c1e78b0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0611312 Aug 24 03:05:45.715482 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e13420de-c51a-402f-82fb-57fd04cc2ef0 req-c4b1c52f-a92c-415d-8929-72ad12a1bbbb tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0321336 Aug 24 03:05:46.528039 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17da705-db1c-4bc4-9f07-c0e922425cd1 req-3c13cccd-ea53-4695-83d1-d5728cb3fe37 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:46.529505 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e17da705-db1c-4bc4-9f07-c0e922425cd1 req-3c13cccd-ea53-4695-83d1-d5728cb3fe37 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 943 time: 0.0487368 Aug 24 03:05:46.570401 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e17da705-db1c-4bc4-9f07-c0e922425cd1 req-823a9304-ca8c-4bad-a6b4-de4078b12cc4 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0349002 Aug 24 03:05:46.844249 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f0561e9-76db-40c9-be36-5375bce74712 req-98607ffd-cfbb-460e-8fe5-6acd2a1a8cc4 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:46.845777 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6f0561e9-76db-40c9-be36-5375bce74712 req-98607ffd-cfbb-460e-8fe5-6acd2a1a8cc4 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0514340 Aug 24 03:05:46.882709 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6f0561e9-76db-40c9-be36-5375bce74712 req-64ccb985-780c-47fa-a8ef-dbfa44f3fc35 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310662 Aug 24 03:05:47.684525 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7c611f-3b76-4dae-8d45-140b19c8927f req-7d4e5d83-789a-449f-bd27-e9e9dcdc0ad2 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:47.686010 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9f7c611f-3b76-4dae-8d45-140b19c8927f req-7d4e5d83-789a-449f-bd27-e9e9dcdc0ad2 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 943 time: 0.0485160 Aug 24 03:05:47.724169 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9f7c611f-3b76-4dae-8d45-140b19c8927f req-3b3d1c4d-1196-428e-b347-235d3c6da011 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322018 Aug 24 03:05:48.002036 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484a4315-afff-43e8-91a3-cfa3ce2d3de1 req-c5b83a57-1faf-4b80-9040-fda6730eaf2f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:48.003507 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-484a4315-afff-43e8-91a3-cfa3ce2d3de1 req-c5b83a57-1faf-4b80-9040-fda6730eaf2f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0489545 Aug 24 03:05:48.045532 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-484a4315-afff-43e8-91a3-cfa3ce2d3de1 req-929da29f-7bb7-4568-8566-ea2c847bbf57 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0360639 Aug 24 03:05:48.840360 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c89f1462-5757-46cb-831f-155c1a1b166f req-0d288aa8-8cf2-4954-bc97-e1a02befdaab tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:48.841745 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c89f1462-5757-46cb-831f-155c1a1b166f req-0d288aa8-8cf2-4954-bc97-e1a02befdaab tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 943 time: 0.0484164 Aug 24 03:05:48.879176 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c89f1462-5757-46cb-831f-155c1a1b166f req-dd73887a-e63e-49bf-ac21-b6d29438844c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316069 Aug 24 03:05:49.166259 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23f608b0-44ad-41de-a410-19a890814df4 req-b5cc0014-65a9-4b87-819e-333632573a95 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:49.167709 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-23f608b0-44ad-41de-a410-19a890814df4 req-b5cc0014-65a9-4b87-819e-333632573a95 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0494730 Aug 24 03:05:49.206057 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-23f608b0-44ad-41de-a410-19a890814df4 req-0f7e50ed-7bcb-4777-8580-a18fdd8be4d8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0321431 Aug 24 03:05:49.993292 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75e3a6c4-a6d4-45d0-83f1-243bc38e2502 req-3be27d90-0393-46d3-b833-0892c24f68d9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:49.994764 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-75e3a6c4-a6d4-45d0-83f1-243bc38e2502 req-3be27d90-0393-46d3-b833-0892c24f68d9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 943 time: 0.0495331 Aug 24 03:05:50.036131 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-75e3a6c4-a6d4-45d0-83f1-243bc38e2502 req-0a83bd30-2c7e-4aa4-909e-bcbe61cb3738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0348840 Aug 24 03:05:50.328516 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5611ac-7ff6-4e7e-b367-4a777b8383f6 req-b62f445e-6deb-4ca7-90a6-4a685eba7120 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:50.329988 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ef5611ac-7ff6-4e7e-b367-4a777b8383f6 req-b62f445e-6deb-4ca7-90a6-4a685eba7120 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0529475 Aug 24 03:05:50.367200 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ef5611ac-7ff6-4e7e-b367-4a777b8383f6 req-9dd477ed-4f2e-4bfa-8097-659d23725c07 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313859 Aug 24 03:05:51.148597 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-815e9472-c7fe-442c-807c-d62331f472c8 req-498877fc-ac42-4136-bcee-3f46d7ca5ed7 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:51.150086 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-815e9472-c7fe-442c-807c-d62331f472c8 req-498877fc-ac42-4136-bcee-3f46d7ca5ed7 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 943 time: 0.0487881 Aug 24 03:05:51.187691 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-815e9472-c7fe-442c-807c-d62331f472c8 req-31d18c52-d041-4994-b763-00cee74e4b2f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0314534 Aug 24 03:05:51.374953 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9d03b984-7bcf-47d3-a99e-16ffa78d9230 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:51.486091 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03e2c1d9-f05e-4561-9bfa-bd3cca037451 req-f179bb79-091b-4768-b4f2-c4dc403136b7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:51.487557 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-03e2c1d9-f05e-4561-9bfa-bd3cca037451 req-f179bb79-091b-4768-b4f2-c4dc403136b7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0480583 Aug 24 03:05:51.528216 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-03e2c1d9-f05e-4561-9bfa-bd3cca037451 req-aa01dae7-8fed-442c-aa6e-0d31f71c77c1 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0347583 Aug 24 03:05:52.303537 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-231f83a3-542b-4e8f-8eab-78889ed168d1 req-ab87140e-3f64-414b-a1c1-f5b6d244f3fe tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:52.304915 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-231f83a3-542b-4e8f-8eab-78889ed168d1 req-ab87140e-3f64-414b-a1c1-f5b6d244f3fe tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 943 time: 0.0484209 Aug 24 03:05:52.345565 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-231f83a3-542b-4e8f-8eab-78889ed168d1 req-ef4c4e89-8b6c-45b2-8bcd-893650135c2d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0343208 Aug 24 03:05:52.568092 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:05:52.651372 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eabe8db-e290-4406-aac8-0507f025c869 req-c132a1e1-54b4-4f79-9046-68b1e748c3e6 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:52.651787 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8eabe8db-e290-4406-aac8-0507f025c869 req-c132a1e1-54b4-4f79-9046-68b1e748c3e6 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0519502 Aug 24 03:05:52.690939 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-8eabe8db-e290-4406-aac8-0507f025c869 req-333d7d30-7a66-435c-85db-bc71664cea7a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0332413 Aug 24 03:05:53.068359 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 38640) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:53.174823 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-dd102ddf-eb88-4bc3-a4ae-40737db40c6e admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:53.259968 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-dd102ddf-eb88-4bc3-a4ae-40737db40c6e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:53.334992 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-dd102ddf-eb88-4bc3-a4ae-40737db40c6e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:53.373960 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-dd102ddf-eb88-4bc3-a4ae-40737db40c6e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b9931277b80c44cfba664830af01c3dc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3044932 Aug 24 03:05:53.374877 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd102ddf-eb88-4bc3-a4ae-40737db40c6e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bf953ac1-eddd-4724-a7a9-1a3615e2db96,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:53.376803 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38646) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:53.460622 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-85e69701-ec99-4473-ac06-0c4cce698f66 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:53.482233 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b40c7e3d-3ac6-4c78-8d77-9b23e1ccfc78 req-7e3cc166-641b-4a04-913f-268009f2eb18 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:53.483741 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b40c7e3d-3ac6-4c78-8d77-9b23e1ccfc78 req-7e3cc166-641b-4a04-913f-268009f2eb18 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 943 time: 0.0718994 Aug 24 03:05:53.500744 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-85e69701-ec99-4473-ac06-0c4cce698f66 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:53.550244 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b40c7e3d-3ac6-4c78-8d77-9b23e1ccfc78 req-dd0b94c8-e832-4467-bd0a-40b53cddce4d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0588062 Aug 24 03:05:53.639153 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-85e69701-ec99-4473-ac06-0c4cce698f66 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:53.641953 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-85e69701-ec99-4473-ac06-0c4cce698f66 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:53.644407 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-85e69701-ec99-4473-ac06-0c4cce698f66 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/bf953ac1-eddd-4724-a7a9-1a3615e2db96 HTTP/1.1" status: 204 len: 168 time: 0.2658658 Aug 24 03:05:53.653593 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85e69701-ec99-4473-ac06-0c4cce698f66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf953ac1-eddd-4724-a7a9-1a3615e2db96,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:53.826362 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7a3cc99-7643-4a3c-8cff-6c55e44e03c4 req-3e022b5b-1cd4-4545-97ac-33d94e14af4f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:53.828031 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c7a3cc99-7643-4a3c-8cff-6c55e44e03c4 req-3e022b5b-1cd4-4545-97ac-33d94e14af4f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0582180 Aug 24 03:05:53.879657 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c7a3cc99-7643-4a3c-8cff-6c55e44e03c4 req-eb7d69ae-88fa-4422-824b-9a1ba6ad2c1c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453229 Aug 24 03:05:53.957636 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device a8f7945f-96cc-40aa-897c-b9f7dd88be75 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:05:53.999106 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-898df652-8845-486a-ae3e-1b8ce7fb25bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:54.066207 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port a8f7945f-96cc-40aa-897c-b9f7dd88be75, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=a8f7945f-96cc-40aa-897c-b9f7dd88be75,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:05:54.077470 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'port_id': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'mac_address': 'fa:16:3e:af:19:81', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 385, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:05:54.118706 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:54.132798 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a8f7945f-96cc-40aa-897c-b9f7dd88be75 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:05:54.152328 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port a8f7945f-96cc-40aa-897c-b9f7dd88be75, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=a8f7945f-96cc-40aa-897c-b9f7dd88be75,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:05:54.295477 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:54.338096 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 38664) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:54.346072 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=a8f7945f-96cc-40aa-897c-b9f7dd88be75,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:54.351823 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-1a755346-f9b3-49ee-9e2f-a0f27b0c1027 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:54.354904 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:54.354904 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:54.354904 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:54.354904 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:54.354904 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:54.354904 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:54.355621 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:54.355621 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:54.355621 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:54.356488 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:54.356706 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:54.357036 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:05:54.375185 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:54.442622 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-1a755346-f9b3-49ee-9e2f-a0f27b0c1027 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:54.544055 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['a8f7945f-96cc-40aa-897c-b9f7dd88be75'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:05:54.569247 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-1a755346-f9b3-49ee-9e2f-a0f27b0c1027 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:54.613334 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-1a755346-f9b3-49ee-9e2f-a0f27b0c1027 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=248e701e18534449873020d6e81a85a9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2717214 Aug 24 03:05:54.613334 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a755346-f9b3-49ee-9e2f-a0f27b0c1027 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8159d00-e4e5-4904-8076-ed5ab5a76cdf,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:54.613738 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38670) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:54.716767 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-14b3e79b-9671-4af8-bd6e-1d8ecc705f1d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:54.746228 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1436cc28-ab72-4abc-8b57-d83a4ff152df req-ef7eec2e-fd5c-4182-83f7-27040531c10f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:54.747874 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1436cc28-ab72-4abc-8b57-d83a4ff152df req-ef7eec2e-fd5c-4182-83f7-27040531c10f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 944 time: 0.0940328 Aug 24 03:05:54.757864 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-14b3e79b-9671-4af8-bd6e-1d8ecc705f1d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:54.817598 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1436cc28-ab72-4abc-8b57-d83a4ff152df req-89dbad29-25e3-46a4-a829-e843cb34fce9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0618219 Aug 24 03:05:54.928620 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-14b3e79b-9671-4af8-bd6e-1d8ecc705f1d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:54.931146 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-14b3e79b-9671-4af8-bd6e-1d8ecc705f1d admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:54.932608 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-14b3e79b-9671-4af8-bd6e-1d8ecc705f1d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d8159d00-e4e5-4904-8076-ed5ab5a76cdf HTTP/1.1" status: 204 len: 168 time: 0.3171849 Aug 24 03:05:54.940753 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14b3e79b-9671-4af8-bd6e-1d8ecc705f1d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8159d00-e4e5-4904-8076-ed5ab5a76cdf,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:54.997772 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e26d7b-0465-4dc6-8a7a-793ae8d70a51 req-016be86f-3c68-41cc-8d72-28be173d6a30 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:54.999310 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-73e26d7b-0465-4dc6-8a7a-793ae8d70a51 req-016be86f-3c68-41cc-8d72-28be173d6a30 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0525033 Aug 24 03:05:55.038399 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-73e26d7b-0465-4dc6-8a7a-793ae8d70a51 req-62056d5f-d959-441a-964e-04ac58ad5947 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0326209 Aug 24 03:05:55.643544 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:55.938967 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf218f6-9a50-4189-ace6-69f11132d938 req-31ebc1a6-f23e-4148-a3bf-6a764bd318aa tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:55.940430 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4bf218f6-9a50-4189-ace6-69f11132d938 req-31ebc1a6-f23e-4148-a3bf-6a764bd318aa tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 944 time: 0.0533619 Aug 24 03:05:55.960608 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device a8f7945f-96cc-40aa-897c-b9f7dd88be75 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:05:55.977388 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4bf218f6-9a50-4189-ace6-69f11132d938 req-d940efc7-74c6-4f5d-ad20-83d099ed1c15 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309834 Aug 24 03:05:56.107852 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port a8f7945f-96cc-40aa-897c-b9f7dd88be75 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:05:56.117834 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port a8f7945f-96cc-40aa-897c-b9f7dd88be75 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:05:56.118405 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:56.173997 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6206dc-d0d2-4b84-86bf-b35b5bb910a1 req-4e88ee42-1564-466f-af46-8b7701ddb4c5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:56.175731 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4a6206dc-d0d2-4b84-86bf-b35b5bb910a1 req-4e88ee42-1564-466f-af46-8b7701ddb4c5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0558622 Aug 24 03:05:56.207638 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:56.219735 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4a6206dc-d0d2-4b84-86bf-b35b5bb910a1 req-e586d20e-3ed8-440e-b8af-825b1c301aa8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0367270 Aug 24 03:05:56.238629 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5b446c10-d1d6-4e68-959c-417655d2070b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:05:56.238629 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fbffbdc6-b247-4d51-8b60-bd6ce6ca35e4" -d '{"events": [{"server_uuid": "5b446c10-d1d6-4e68-959c-417655d2070b", "name": "network-vif-plugged", "status": "completed", "tag": "a8f7945f-96cc-40aa-897c-b9f7dd88be75"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:05:56.250241 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port a8f7945f-96cc-40aa-897c-b9f7dd88be75, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=a8f7945f-96cc-40aa-897c-b9f7dd88be75,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:05:56.323956 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:56.374152 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=a8f7945f-96cc-40aa-897c-b9f7dd88be75,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:56.407705 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:05:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aeed65d9-0112-425c-b3e9-06b3a3e65fef x-openstack-request-id: req-aeed65d9-0112-425c-b3e9-06b3a3e65fef {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:05:56.408247 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5b446c10-d1d6-4e68-959c-417655d2070b", "name": "network-vif-plugged", "status": "completed", "tag": "a8f7945f-96cc-40aa-897c-b9f7dd88be75", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:05:56.408568 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-aeed65d9-0112-425c-b3e9-06b3a3e65fef {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:05:56.409075 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5b446c10-d1d6-4e68-959c-417655d2070b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'code': 200} Aug 24 03:05:56.780906 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38726) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:56.894544 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-68f865cd-3517-4e8b-8dcc-9ea172d69b88 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:56.901194 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb0f66a0-964d-4910-b12f-c36851795b59 req-ce5288d5-79d6-46e2-ba72-37bf75260598 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:56.903654 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fb0f66a0-964d-4910-b12f-c36851795b59 req-ce5288d5-79d6-46e2-ba72-37bf75260598 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 1098 time: 0.0419292 Aug 24 03:05:56.929618 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:56.943518 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fb0f66a0-964d-4910-b12f-c36851795b59 req-bcd78bde-b036-48c0-bbd6-5fa6bbdb3320 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0328379 Aug 24 03:05:56.989302 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-68f865cd-3517-4e8b-8dcc-9ea172d69b88 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:57.066287 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-68f865cd-3517-4e8b-8dcc-9ea172d69b88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:57.098602 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c8d37e-81db-4254-b1db-ddc2e564b23a req-85734982-6db0-4c61-a21f-52b4b6248aae tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:57.100118 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a5c8d37e-81db-4254-b1db-ddc2e564b23a req-85734982-6db0-4c61-a21f-52b4b6248aae tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 945 time: 0.0516572 Aug 24 03:05:57.104360 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-68f865cd-3517-4e8b-8dcc-9ea172d69b88 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=be2fd727a1e04c1cb5b885b1fa8ddcdf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3223937 Aug 24 03:05:57.106967 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f865cd-3517-4e8b-8dcc-9ea172d69b88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59f64087-9ef1-4046-a347-57fa8e24dea3,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:57.109066 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 38732) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:57.170943 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a5c8d37e-81db-4254-b1db-ddc2e564b23a req-07033dbc-13ab-460b-9748-890dec58babd tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0625899 Aug 24 03:05:57.184396 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f3a52c79-0fce-4343-b8c9-5479d6eadb44 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:57.206438 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f3a52c79-0fce-4343-b8c9-5479d6eadb44 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:57.300605 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f3a52c79-0fce-4343-b8c9-5479d6eadb44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:57.303333 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-f3a52c79-0fce-4343-b8c9-5479d6eadb44 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:57.306082 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-f3a52c79-0fce-4343-b8c9-5479d6eadb44 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/59f64087-9ef1-4046-a347-57fa8e24dea3 HTTP/1.1" status: 204 len: 168 time: 0.1960299 Aug 24 03:05:57.315964 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3a52c79-0fce-4343-b8c9-5479d6eadb44 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59f64087-9ef1-4046-a347-57fa8e24dea3,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:57.365867 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35fbc4d2-8d81-44d9-ba2a-5f876aec122f req-c82c16a7-3e88-4969-962c-df87507049e8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:57.367711 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-35fbc4d2-8d81-44d9-ba2a-5f876aec122f req-c82c16a7-3e88-4969-962c-df87507049e8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0702519 Aug 24 03:05:57.414260 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-35fbc4d2-8d81-44d9-ba2a-5f876aec122f req-bdf31387-705b-4750-981a-2d8fbe8d3c9e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400460 Aug 24 03:05:57.962862 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:05:58.059265 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:05:58.069667 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'port_id': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'mac_address': 'fa:16:3e:0a:41:69', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:05:58.107996 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:58.121656 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:05:58.153702 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:05:58.255307 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:05:58.295479 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7302939f-e565-46f1-b099-4774bf34fad8 req-2adb2076-6703-4002-881c-fd26a6b85696 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:58.297770 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7302939f-e565-46f1-b099-4774bf34fad8 req-2adb2076-6703-4002-881c-fd26a6b85696 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 945 time: 0.0568426 Aug 24 03:05:58.315922 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,revision_number=6']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:05:58.342254 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:05:58.357986 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7302939f-e565-46f1-b099-4774bf34fad8 req-ac74ef5d-16ad-4318-98e6-26e8487a4440 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537553 Aug 24 03:05:58.543633 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e948f0f-a729-4a8d-ad62-8c57d8dbf8b2 req-ba2aedd5-b522-4c18-b8c8-233dc3b95703 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:58.545123 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4e948f0f-a729-4a8d-ad62-8c57d8dbf8b2 req-ba2aedd5-b522-4c18-b8c8-233dc3b95703 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 945 time: 0.0523639 Aug 24 03:05:58.584841 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4e948f0f-a729-4a8d-ad62-8c57d8dbf8b2 req-b56fc077-cf42-441f-8214-041ba61397d9 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0335789 Aug 24 03:05:59.474916 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49b28cf-a96d-4c10-812a-3204123ff941 req-a2819b7e-7b75-45af-9e5e-c8c90bed2f55 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:59.477249 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a49b28cf-a96d-4c10-812a-3204123ff941 req-a2819b7e-7b75-45af-9e5e-c8c90bed2f55 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 945 time: 0.0581264 Aug 24 03:05:59.523233 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a49b28cf-a96d-4c10-812a-3204123ff941 req-10f28216-25bd-4edb-9bc0-667a3a73c1a0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382295 Aug 24 03:05:59.753307 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39daca0f-c42c-42d2-b433-63ce8b4550b8 req-135c55ed-55af-4a9b-821c-8381b87abc2e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:59.755674 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-39daca0f-c42c-42d2-b433-63ce8b4550b8 req-135c55ed-55af-4a9b-821c-8381b87abc2e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 945 time: 0.1004038 Aug 24 03:05:59.781187 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-910512b0-e14d-4ff5-b4a1-6c69fb6bf6de req-8fb91dd2-cdfe-4109-b9b0-09e426b76930 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:59.789661 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-910512b0-e14d-4ff5-b4a1-6c69fb6bf6de req-8fb91dd2-cdfe-4109-b9b0-09e426b76930 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 945 time: 0.0728986 Aug 24 03:05:59.819389 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-39daca0f-c42c-42d2-b433-63ce8b4550b8 req-ec51f7c0-f25f-42f7-9b61-b26734fb8c0d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542901 Aug 24 03:05:59.832147 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-910512b0-e14d-4ff5-b4a1-6c69fb6bf6de req-25fd010e-3778-48bb-b5ed-27fb93fb6191 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413196 Aug 24 03:05:59.851531 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 38842) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:59.904844 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39fd7dbc-6b01-4cd6-a796-e6b5efbaafcf tempest-TestVolumeBootPattern-1918149566 tempest-TestVolumeBootPattern-1918149566-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:05:59.907099 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-39fd7dbc-6b01-4cd6-a796-e6b5efbaafcf tempest-TestVolumeBootPattern-1918149566 tempest-TestVolumeBootPattern-1918149566-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 1093 time: 0.0542874 Aug 24 03:05:59.910252 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 38846) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:05:59.917567 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'floatingip': {'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'port_id': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address': '172.20.0.3'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:05:59.989219 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:06:00.010687 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:00.058936 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:06:00.059945 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:00.155584 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:00.299286 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Allocated IP 172.27.2.136 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/c3ff8651-849b-44d4-9b54-c66e81407c59) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:06:00.314045 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:00.345315 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:06:00.347032 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0f58ec30-397b-42d5-8203-88a89c9e64e4" -d '{"events": [{"server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "name": "network-vif-plugged", "status": "completed", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:06:00.362882 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:06:00.393650 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:06:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71149538-90e2-41e9-92b4-26d8e871ccbb x-openstack-request-id: req-71149538-90e2-41e9-92b4-26d8e871ccbb {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:06:00.394037 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "name": "network-vif-plugged", "status": "completed", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:06:00.394374 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-71149538-90e2-41e9-92b4-26d8e871ccbb {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:06:00.395158 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'code': 200} Aug 24 03:06:00.455188 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:00.466808 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:00.505473 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,revision_number=7']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:00.619242 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:00.669767 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:06:00.674119 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:06:00.676687 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:06:00.685509 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'Port': ['ID=c3ff8651-849b-44d4-9b54-c66e81407c59,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:01.020193 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6a0492d-3068-45cc-90f9-3f377ce18670 req-b95ddf26-bb55-4bfa-9e5b-95540b732567 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:01.021826 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e6a0492d-3068-45cc-90f9-3f377ce18670 req-b95ddf26-bb55-4bfa-9e5b-95540b732567 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0927546 Aug 24 03:06:01.363428 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e6a0492d-3068-45cc-90f9-3f377ce18670 req-79f03f71-bb14-4794-be90-966154b13dda tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3352628 Aug 24 03:06:01.448212 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:01.585502 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:01.757707 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:01.837723 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:01.910331 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'Port': ['ID=c3ff8651-849b-44d4-9b54-c66e81407c59,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:01.924906 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:02.035133 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.l3_db [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Floating IP bb5fca44-f88d-40fe-b3a8-a36920d12ada associated. External IP: 172.27.2.136, port: a8f7945f-96cc-40aa-897c-b9f7dd88be75. Aug 24 03:06:02.263159 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:06:02.393108 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:06:02.408928 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6ea00ce-d55a-4eb2-bd1f-8b7e814d083e None None] Sync routers for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:06:02.421814 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6ea00ce-d55a-4eb2-bd1f-8b7e814d083e None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:06:02.421814 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-b6ea00ce-d55a-4eb2-bd1f-8b7e814d083e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:05:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:02.513503 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5931c6a6-dae6-4723-b958-f62d096803a8 req-d5e6f35d-f14b-4ede-a754-03f0a082f0a7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:02.514920 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5931c6a6-dae6-4723-b958-f62d096803a8 req-d5e6f35d-f14b-4ede-a754-03f0a082f0a7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0578980 Aug 24 03:06:02.534566 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-b6ea00ce-d55a-4eb2-bd1f-8b7e814d083e None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:06:02.541637 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:02.574208 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5931c6a6-dae6-4723-b958-f62d096803a8 req-b8ab9956-5c2e-4f5e-9167-2a42fd430610 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478773 Aug 24 03:06:02.591193 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-ed496065-f9f6-47f5-a447-443014e6d327 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.6790397 Aug 24 03:06:02.592033 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5b446c10-d1d6-4e68-959c-417655d2070b', 'tag': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:06:02.594824 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e08d7ae5-2f10-4deb-a245-dc089fbbf8e3" -d '{"events": [{"name": "network-changed", "server_uuid": "5b446c10-d1d6-4e68-959c-417655d2070b", "tag": "a8f7945f-96cc-40aa-897c-b9f7dd88be75"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:06:02.650148 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:06:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7863b0a-9d2c-48f1-bb2e-98878130d4fc x-openstack-request-id: req-b7863b0a-9d2c-48f1-bb2e-98878130d4fc {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:06:02.650687 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5b446c10-d1d6-4e68-959c-417655d2070b", "tag": "a8f7945f-96cc-40aa-897c-b9f7dd88be75", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:06:02.652008 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-b7863b0a-9d2c-48f1-bb2e-98878130d4fc {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:06:02.652008 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5b446c10-d1d6-4e68-959c-417655d2070b', 'tag': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'status': 'completed', 'code': 200} Aug 24 03:06:02.727577 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08d7ae5-2f10-4deb-a245-dc089fbbf8e3 req-e3ca68f3-7043-4e01-bb48-38a28057f945 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:02.734117 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e08d7ae5-2f10-4deb-a245-dc089fbbf8e3 req-e3ca68f3-7043-4e01-bb48-38a28057f945 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 1098 time: 0.0621090 Aug 24 03:06:02.819856 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-b6ea00ce-d55a-4eb2-bd1f-8b7e814d083e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'bb5fca44-f88d-40fe-b3a8-a36920d12ada', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.136', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 507, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:af:19:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b446c10-d1d6-4e68-959c-417655d2070b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:06:00Z', 'updated_at': '2021-08-24T03:06:00Z', 'revision_number': 0, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:02.850599 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6ea00ce-d55a-4eb2-bd1f-8b7e814d083e None None] Checking router: 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:06:02.859758 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6ea00ce-d55a-4eb2-bd1f-8b7e814d083e None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:06:02.860950 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-b6ea00ce-d55a-4eb2-bd1f-8b7e814d083e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:05:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:02.870042 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08d7ae5-2f10-4deb-a245-dc089fbbf8e3 req-e5d6b385-c87d-419a-84c6-97144e7c16f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:02.872123 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e08d7ae5-2f10-4deb-a245-dc089fbbf8e3 req-e5d6b385-c87d-419a-84c6-97144e7c16f8 service neutron] 10.222.0.43 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 913 time: 0.1301177 Aug 24 03:06:02.980544 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e08d7ae5-2f10-4deb-a245-dc089fbbf8e3 req-eeeb9c17-b472-4571-a5bd-c2b79a6b3453 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a8f7945f-96cc-40aa-897c-b9f7dd88be75 HTTP/1.1" status: 200 len: 999 time: 0.1003540 Aug 24 03:06:03.001935 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-b6ea00ce-d55a-4eb2-bd1f-8b7e814d083e None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:06:03.060842 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08d7ae5-2f10-4deb-a245-dc089fbbf8e3 req-f35b7fdd-fb85-407c-815b-0c700e0739ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:03.062534 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e08d7ae5-2f10-4deb-a245-dc089fbbf8e3 req-f35b7fdd-fb85-407c-815b-0c700e0739ca service neutron] 10.222.0.43 "GET /v2.0/subnets?id=9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 200 len: 851 time: 0.0749395 Aug 24 03:06:03.138596 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08d7ae5-2f10-4deb-a245-dc089fbbf8e3 req-bb4b9dc6-0f1e-481a-abcf-b84709a4d492 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:03.145997 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e08d7ae5-2f10-4deb-a245-dc089fbbf8e3 req-bb4b9dc6-0f1e-481a-abcf-b84709a4d492 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0688269 Aug 24 03:06:03.255657 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e08d7ae5-2f10-4deb-a245-dc089fbbf8e3 req-9c8cdebd-daeb-4eb4-8da3-4b46f8830eff service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1064677 Aug 24 03:06:03.274166 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-b6ea00ce-d55a-4eb2-bd1f-8b7e814d083e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'bb5fca44-f88d-40fe-b3a8-a36920d12ada', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.136', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 507, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:af:19:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b446c10-d1d6-4e68-959c-417655d2070b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:06:00Z', 'updated_at': '2021-08-24T03:06:00Z', 'revision_number': 0, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:03.323269 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6ea00ce-d55a-4eb2-bd1f-8b7e814d083e None None] The sync data for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi is: [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'bb5fca44-f88d-40fe-b3a8-a36920d12ada', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.136', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 507, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:af:19:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b446c10-d1d6-4e68-959c-417655d2070b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:06:00Z', 'updated_at': '2021-08-24T03:06:00Z', 'revision_number': 0, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:06:03.370663 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e08d7ae5-2f10-4deb-a245-dc089fbbf8e3 req-38b61cc0-dbb8-4025-9c8f-5d97c9263c08 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1070256 Aug 24 03:06:03.612615 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d3c0250-1414-4905-9c02-ab432cc47c64 None None] New status for floating IP bb5fca44-f88d-40fe-b3a8-a36920d12ada: ACTIVE {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:06:03.730175 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcafc1db-1873-4979-a9be-5964f5897f0f req-75f5b6be-75b0-4338-898b-d4221960ab62 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:03.734126 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fcafc1db-1873-4979-a9be-5964f5897f0f req-75f5b6be-75b0-4338-898b-d4221960ab62 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0739760 Aug 24 03:06:03.800578 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fcafc1db-1873-4979-a9be-5964f5897f0f req-d4f526d9-f8c9-4662-affd-60c9b75ea9e8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0601454 Aug 24 03:06:04.937748 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca70da53-38dc-4468-943c-a065e89da0e3 req-2811be85-9b77-49ee-9237-854fd8dded19 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:04.942776 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ca70da53-38dc-4468-943c-a065e89da0e3 req-2811be85-9b77-49ee-9237-854fd8dded19 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0587988 Aug 24 03:06:04.986354 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ca70da53-38dc-4468-943c-a065e89da0e3 req-453662bf-0af8-4bb0-8566-466453a074d4 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411863 Aug 24 03:06:06.114012 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50aa1c6f-af77-47e7-a3d9-a3408ef948ba req-7db73eb1-eec5-4660-8bd6-3a2ef6242e05 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:06.115988 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-50aa1c6f-af77-47e7-a3d9-a3408ef948ba req-7db73eb1-eec5-4660-8bd6-3a2ef6242e05 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0507641 Aug 24 03:06:06.180501 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-50aa1c6f-af77-47e7-a3d9-a3408ef948ba req-6d9ee025-aa66-42ab-a049-4ee8c9176c4e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447154 Aug 24 03:06:07.322975 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f097eb-3f91-4a89-a846-74c934458978 req-98780243-6b2f-4b76-a926-2606be6969d7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:07.325179 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-95f097eb-3f91-4a89-a846-74c934458978 req-98780243-6b2f-4b76-a926-2606be6969d7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0704520 Aug 24 03:06:07.372510 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-95f097eb-3f91-4a89-a846-74c934458978 req-ecbd3d90-fb06-4cf1-9c47-e154ff814883 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397370 Aug 24 03:06:08.520935 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc33461e-4c56-4c43-a158-72356498526e req-5636940b-c906-43be-8a9e-dcf7b6f92547 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:08.529198 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-dc33461e-4c56-4c43-a158-72356498526e req-5636940b-c906-43be-8a9e-dcf7b6f92547 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0663147 Aug 24 03:06:08.571502 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-dc33461e-4c56-4c43-a158-72356498526e req-f0f84801-22af-4842-b332-488e7bf7c45e tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414188 Aug 24 03:06:08.661363 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:09.697936 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26ba69f4-3ba2-4ed8-8942-f7a1d701e9bc req-45136c58-b13b-4c4a-94bf-8f990a144085 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:09.699593 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-26ba69f4-3ba2-4ed8-8942-f7a1d701e9bc req-45136c58-b13b-4c4a-94bf-8f990a144085 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0501730 Aug 24 03:06:09.740907 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-26ba69f4-3ba2-4ed8-8942-f7a1d701e9bc req-34146ce1-6c72-4f26-a03e-58c160f9fced tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0351090 Aug 24 03:06:10.872187 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa601407-0e3f-40eb-92ce-07a338ed9d24 req-c0f6a77f-d2fa-457d-bc21-9ef5b9139384 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:10.873869 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-aa601407-0e3f-40eb-92ce-07a338ed9d24 req-c0f6a77f-d2fa-457d-bc21-9ef5b9139384 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0546882 Aug 24 03:06:10.912593 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-aa601407-0e3f-40eb-92ce-07a338ed9d24 req-3a5971a7-ae7b-42c1-8e3f-5b617694cadc tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0327909 Aug 24 03:06:11.540824 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b913376c-dfb6-4ef5-83a9-ed3207238fff req-8f4d75dd-a8f6-4df2-94ff-ba1cb4c45572 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:11.542340 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b913376c-dfb6-4ef5-83a9-ed3207238fff req-8f4d75dd-a8f6-4df2-94ff-ba1cb4c45572 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=6b319ec439ef48f18d76e47df6300bc6&device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 1099 time: 0.0407050 Aug 24 03:06:11.632015 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b913376c-dfb6-4ef5-83a9-ed3207238fff req-a8b9dfe0-fa5d-47e9-90f0-bbedb1bbe9f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:11.633474 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b913376c-dfb6-4ef5-83a9-ed3207238fff req-a8b9dfe0-fa5d-47e9-90f0-bbedb1bbe9f7 service neutron] 10.222.0.43 "GET /v2.0/networks?id=72400947-ffa3-49a8-8805-03fdb89d0cfb HTTP/1.1" status: 200 len: 918 time: 0.0838420 Aug 24 03:06:11.705559 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b913376c-dfb6-4ef5-83a9-ed3207238fff req-eadaed1d-2784-4423-801a-cc66e8462fee service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 HTTP/1.1" status: 200 len: 1002 time: 0.0636253 Aug 24 03:06:11.783522 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b913376c-dfb6-4ef5-83a9-ed3207238fff req-877a7ec2-4803-4a8f-a694-c64f972df724 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:11.784953 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b913376c-dfb6-4ef5-83a9-ed3207238fff req-877a7ec2-4803-4a8f-a694-c64f972df724 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=465e9b83-ccde-4ea3-8e80-86590891b03c HTTP/1.1" status: 200 len: 856 time: 0.0725484 Aug 24 03:06:11.800851 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dc0bb34-2cf9-43b2-a609-d98960c748a0 req-ebe30c18-ab39-403f-859a-817feb6cd665 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:11.802292 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7dc0bb34-2cf9-43b2-a609-d98960c748a0 req-ebe30c18-ab39-403f-859a-817feb6cd665 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 946 time: 0.0639057 Aug 24 03:06:11.863201 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7dc0bb34-2cf9-43b2-a609-d98960c748a0 req-1ea661fe-9efe-4af0-b19a-44b2ceb2d52f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535674 Aug 24 03:06:11.865626 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b913376c-dfb6-4ef5-83a9-ed3207238fff req-b0a57454-06ec-420f-b7d3-a899b6c0e680 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:11.867005 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b913376c-dfb6-4ef5-83a9-ed3207238fff req-b0a57454-06ec-420f-b7d3-a899b6c0e680 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=72400947-ffa3-49a8-8805-03fdb89d0cfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0736887 Aug 24 03:06:11.964771 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b913376c-dfb6-4ef5-83a9-ed3207238fff req-f89f813a-b848-46ad-af1d-9c0f6044b246 service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884361 Aug 24 03:06:12.042747 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b980e0a1-bc6e-4efb-b0c4-ba108d22f8ed req-255db94b-ea6a-4a8f-a4a2-ab2b3f9e66c8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:12.044396 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b980e0a1-bc6e-4efb-b0c4-ba108d22f8ed req-255db94b-ea6a-4a8f-a4a2-ab2b3f9e66c8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0570531 Aug 24 03:06:12.063790 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b913376c-dfb6-4ef5-83a9-ed3207238fff req-8da7daed-cdc7-4afe-a3b3-22eca32d1e23 service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0913596 Aug 24 03:06:12.082834 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b980e0a1-bc6e-4efb-b0c4-ba108d22f8ed req-f726d652-ab10-4f5f-87ac-15b323c0e0a8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0326593 Aug 24 03:06:12.976501 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064b91fb-bfb8-463e-b006-8fabc5b3e247 req-b8f328c1-f2f3-4c5a-93f2-d9408c560a26 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:12.977995 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064b91fb-bfb8-463e-b006-8fabc5b3e247 req-b8f328c1-f2f3-4c5a-93f2-d9408c560a26 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 946 time: 0.0487175 Aug 24 03:06:13.014736 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-064b91fb-bfb8-463e-b006-8fabc5b3e247 req-4de95975-d64e-4dce-b65c-633f02d83b29 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0300345 Aug 24 03:06:13.202933 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa64435b-be78-4ae7-a8cb-4a6c1279e616 req-908328bf-5a84-4c7c-bf5d-7f443046b0a7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:13.204365 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fa64435b-be78-4ae7-a8cb-4a6c1279e616 req-908328bf-5a84-4c7c-bf5d-7f443046b0a7 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 946 time: 0.0519595 Aug 24 03:06:13.241766 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fa64435b-be78-4ae7-a8cb-4a6c1279e616 req-f8204997-90aa-4407-a75c-4bf2d5553203 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0314658 Aug 24 03:06:13.701984 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-1ba66850-1a60-49cf-bb48-466cf8a13d74 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:13.703383 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-1ba66850-1a60-49cf-bb48-466cf8a13d74 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.43 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 946 time: 0.0517383 Aug 24 03:06:13.797560 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Deleting port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:06:13.797921 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:13.887976 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] For port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:06:13.888337 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:14.059778 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:14.060543 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:14.060668 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.l3_db [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Floating IP 5d85fa94-91bc-410c-84b9-e7cada0fb8a5 disassociated. External IP: 172.27.2.57, port: cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3. Aug 24 03:06:14.060990 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Calling delete_port for cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:06:14.082350 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:06:14.163875 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:14.177535 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e118d051-44f3-4411-a33a-0f993bdde1fc req-dcf078fa-9982-44e4-bfcb-fff6df4e5575 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:14.179124 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e118d051-44f3-4411-a33a-0f993bdde1fc req-dcf078fa-9982-44e4-bfcb-fff6df4e5575 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 946 time: 0.0786264 Aug 24 03:06:14.197750 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:06:14.200466 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5566054a-cef5-4e89-9c12-2bde6e33a3d6" -d '{"events": [{"server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "name": "network-vif-unplugged", "status": "completed", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:06:14.211816 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:06:14.241876 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 24 Aug 2021 03:06:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8003bb10-ce3d-4240-bc2c-fbb83303b7f9 x-openstack-request-id: req-8003bb10-ce3d-4240-bc2c-fbb83303b7f9 {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:06:14.242164 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "name": "network-vif-unplugged", "status": "completed", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:06:14.242410 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-8003bb10-ce3d-4240-bc2c-fbb83303b7f9 {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:06:14.242798 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'code': 200} Aug 24 03:06:14.254089 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e118d051-44f3-4411-a33a-0f993bdde1fc req-ee7dcbd0-a671-4e6c-8884-6baaebc4e841 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups?id=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0656588 Aug 24 03:06:14.271850 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:14.322080 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,revision_number=8']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:14.345407 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:14.367134 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1f094e-6001-4ebc-b30f-7fe35a71f10a req-d4bb1cc7-5293-4b4d-abe7-0a2bf90fc8e0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:14.368618 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-dd1f094e-6001-4ebc-b30f-7fe35a71f10a req-d4bb1cc7-5293-4b4d-abe7-0a2bf90fc8e0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0493882 Aug 24 03:06:14.376252 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event deleted for resources: {'Port': ['ID=cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:14.396704 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:14.398660 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:14.398660 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:14.398660 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:14.398660 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:14.398660 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:14.399197 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:14.399197 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:14.399442 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:14.399770 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:14.400101 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:14.400420 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:14.410307 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-dd1f094e-6001-4ebc-b30f-7fe35a71f10a req-0f77c3d7-35ed-48d0-9162-103e3f672f93 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0348511 Aug 24 03:06:14.508761 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Router 893a8671-6102-43da-9368-0f66640f4cf7 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:06:14.623204 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:06:14.632994 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-992fb103-d679-491e-8e67-12cf307346be None None] Sync routers for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:06:14.648580 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-992fb103-d679-491e-8e67-12cf307346be None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:06:14.649288 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-992fb103-d679-491e-8e67-12cf307346be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:05:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:14.666581 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] No DVR routers for this DVR port cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:06:14.669524 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:14.671569 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b6dbefa4-2ec5-4e14-80a7-7b8c0a182f43 req-60165939-4d73-45ac-8b11-a89d3da59cf4 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.43 "DELETE /v2.0/ports/cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 HTTP/1.1" status: 204 len: 173 time: 0.9597373 Aug 24 03:06:14.671994 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'name': 'network-vif-deleted', 'tag': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:06:14.674231 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00518146-af0e-4256-ae39-a2106a80b194" -d '{"events": [{"server_uuid": "18b2a8a2-7207-4a38-a394-1389dfb35117", "name": "network-vif-deleted", "tag": "cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:06:14.723208 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:06:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-90589f57-78a6-41c2-a6e4-496ea064f1aa x-openstack-request-id: req-90589f57-78a6-41c2-a6e4-496ea064f1aa {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:06:14.723677 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "18b2a8a2-7207-4a38-a394-1389dfb35117", "name": "network-vif-deleted", "tag": "cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:06:14.724173 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-90589f57-78a6-41c2-a6e4-496ea064f1aa {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:06:14.724849 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '18b2a8a2-7207-4a38-a394-1389dfb35117', 'name': 'network-vif-deleted', 'tag': 'cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3', 'status': 'completed', 'code': 200} Aug 24 03:06:14.766271 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-992fb103-d679-491e-8e67-12cf307346be None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:06:14.975691 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-992fb103-d679-491e-8e67-12cf307346be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:43Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:15.007540 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-992fb103-d679-491e-8e67-12cf307346be None None] Checking router: 893a8671-6102-43da-9368-0f66640f4cf7 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:06:15.017180 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-992fb103-d679-491e-8e67-12cf307346be None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:06:15.017828 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-992fb103-d679-491e-8e67-12cf307346be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:05:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:15.135232 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-992fb103-d679-491e-8e67-12cf307346be None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:06:15.365119 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-87a4bbe8-6d55-4cac-a918-3ceb5bec6db5 req-63976477-2a08-43cb-a172-fd99033b0996 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/ports?device_id=18b2a8a2-7207-4a38-a394-1389dfb35117 HTTP/1.1" status: 200 len: 210 time: 0.0270162 Aug 24 03:06:15.456397 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-992fb103-d679-491e-8e67-12cf307346be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:43Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:15.488634 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-992fb103-d679-491e-8e67-12cf307346be None None] The sync data for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi is: [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T02:59:35Z', 'revision_number': 4, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'fe2b62d4-7d80-4b4b-9feb-2311eacbac90', 'name': '', 'network_id': 'f35e751d-f371-4788-abda-6a58b8a779df', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'mac_address': 'fa:16:3e:26:f9:25', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:32Z', 'updated_at': '2021-08-24T02:59:43Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'subnets': [{'id': '14102a94-a55b-43e1-a7a9-4210a4c2e2fb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:06:15.726501 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b68e459-23ae-4141-86a0-a9e0489fb015 None None] New status for floating IP 5d85fa94-91bc-410c-84b9-e7cada0fb8a5: DOWN {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:06:16.557983 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 39058) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:16.615962 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-dc5f78db-55d4-49f7-b965-b710530fc3b9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:16.640712 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-dc5f78db-55d4-49f7-b965-b710530fc3b9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:16.768547 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-dc5f78db-55d4-49f7-b965-b710530fc3b9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:16.771208 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-dc5f78db-55d4-49f7-b965-b710530fc3b9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:16.772404 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-dc5f78db-55d4-49f7-b965-b710530fc3b9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "DELETE /v2.0/security-groups/eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e HTTP/1.1" status: 204 len: 168 time: 0.2129276 Aug 24 03:06:16.775309 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39064) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:16.781999 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc5f78db-55d4-49f7-b965-b710530fc3b9 tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:16.790188 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.api.v2.resource [None req-5ce0ed51-c4ab-4f83-8f71-61695e241e7f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] show failed (client error): The resource could not be found. Aug 24 03:06:16.791159 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-5ce0ed51-c4ab-4f83-8f71-61695e241e7f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "GET /v2.0/security-groups/eb8aadb7-a1eb-4b79-af97-ec46e95f2e0e HTTP/1.1" status: 404 len: 347 time: 0.0143604 Aug 24 03:06:16.795147 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39066) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:16.926039 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74a50355-f2c6-4fe5-8c7a-80b770fae3a7 req-1719d031-d23e-4b9e-887b-cd697ea68e67 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:16.927668 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-74a50355-f2c6-4fe5-8c7a-80b770fae3a7 req-1719d031-d23e-4b9e-887b-cd697ea68e67 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0556736 Aug 24 03:06:16.947827 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-8d9f8936-0647-4f90-a8f5-a13c3afc687f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Deleting port b21cf6c9-5a8f-4ac3-bafa-4fb97bd3f188 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:06:16.948172 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8d9f8936-0647-4f90-a8f5-a13c3afc687f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:16.980370 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-74a50355-f2c6-4fe5-8c7a-80b770fae3a7 req-10a9dfdd-31fb-4bbd-bfe0-29a5d2d79b7c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458355 Aug 24 03:06:17.029877 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8d9f8936-0647-4f90-a8f5-a13c3afc687f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:17.030243 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8d9f8936-0647-4f90-a8f5-a13c3afc687f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:17.044455 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-8d9f8936-0647-4f90-a8f5-a13c3afc687f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Calling delete_port for b21cf6c9-5a8f-4ac3-bafa-4fb97bd3f188 owned by network:floatingip {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:06:17.242695 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8d9f8936-0647-4f90-a8f5-a13c3afc687f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:17.270397 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d9f8936-0647-4f90-a8f5-a13c3afc687f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Pushing event deleted for resources: {'Port': ['ID=b21cf6c9-5a8f-4ac3-bafa-4fb97bd3f188,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:17.339144 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8d9f8936-0647-4f90-a8f5-a13c3afc687f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks [] for floatingip, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:17.339996 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8d9f8936-0647-4f90-a8f5-a13c3afc687f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:17.343932 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-8d9f8936-0647-4f90-a8f5-a13c3afc687f tempest-AttachVolumeTestJSON-10481276 tempest-AttachVolumeTestJSON-10481276-project] 10.222.0.30 "DELETE /v2.0/floatingips/5d85fa94-91bc-410c-84b9-e7cada0fb8a5 HTTP/1.1" status: 204 len: 168 time: 0.5450363 Aug 24 03:06:17.432917 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39100) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:17.518152 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-7c257d0b-99f5-4b40-96cb-a81dab60bd1f service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0833964 Aug 24 03:06:18.083612 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:06:18.106633 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf3b33cc-ae34-4a27-86ea-07549ca8a17b req-29ca76a4-290d-405c-a9e0-c6ce66d06e11 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:18.108132 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-bf3b33cc-ae34-4a27-86ea-07549ca8a17b req-29ca76a4-290d-405c-a9e0-c6ce66d06e11 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0542848 Aug 24 03:06:18.146160 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-bf3b33cc-ae34-4a27-86ea-07549ca8a17b req-2b1ab984-7853-4212-bdbc-02b04a86eba3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0316136 Aug 24 03:06:18.184107 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:06:18.184107 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:06:18.184107 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device cbae3e38-da5b-4ae7-bc7b-c01d49b4f5f3 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:06:18.844383 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39124) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:18.952424 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5e018d3f-fed6-4635-8514-e505f26a9e2a admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:19.039148 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5e018d3f-fed6-4635-8514-e505f26a9e2a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:19.099759 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-5e018d3f-fed6-4635-8514-e505f26a9e2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:19.139237 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-5e018d3f-fed6-4635-8514-e505f26a9e2a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c500a65cba424e02b23b07e8333d4812&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2930751 Aug 24 03:06:19.140127 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e018d3f-fed6-4635-8514-e505f26a9e2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d17fa2a-3f5f-41ca-8f66-3a1b1fddec67,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:19.142418 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39130) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:19.174793 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-1c4a133d-85db-453e-bc42-d6bc003ed6e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:19.174793 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-1c4a133d-85db-453e-bc42-d6bc003ed6e0 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161&tenant_id=6b319ec439ef48f18d76e47df6300bc6 HTTP/1.1" status: 200 len: 1097 time: 0.0411525 Aug 24 03:06:19.194085 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-378c0c1a-b627-470b-93c4-147fe75a50af admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:19.216201 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-378c0c1a-b627-470b-93c4-147fe75a50af admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:19.267673 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-deeea9df-248d-425d-b46d-1d505f3db034 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:19.269214 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-deeea9df-248d-425d-b46d-1d505f3db034 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=6b319ec439ef48f18d76e47df6300bc6&device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 1097 time: 0.0765054 Aug 24 03:06:19.283011 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-798c6cfb-6136-465b-8891-7825d1bfc2ea req-5f04ec97-98f9-4f5e-87fe-be809c7e8d56 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:19.284389 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-798c6cfb-6136-465b-8891-7825d1bfc2ea req-5f04ec97-98f9-4f5e-87fe-be809c7e8d56 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0636125 Aug 24 03:06:19.345327 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-378c0c1a-b627-470b-93c4-147fe75a50af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:19.347901 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-378c0c1a-b627-470b-93c4-147fe75a50af admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:19.349048 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-378c0c1a-b627-470b-93c4-147fe75a50af admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/1d17fa2a-3f5f-41ca-8f66-3a1b1fddec67 HTTP/1.1" status: 204 len: 168 time: 0.2057159 Aug 24 03:06:19.358144 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-378c0c1a-b627-470b-93c4-147fe75a50af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d17fa2a-3f5f-41ca-8f66-3a1b1fddec67,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:19.392978 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-798c6cfb-6136-465b-8891-7825d1bfc2ea req-94fc5aac-805f-40ba-8a6c-dc37ac06cc39 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1004252 Aug 24 03:06:19.422293 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-45599eb9-8835-4d99-b0c9-a0ade9ffb15b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:19.422293 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-45599eb9-8835-4d99-b0c9-a0ade9ffb15b service neutron] 10.222.0.43 "GET /v2.0/networks?id=72400947-ffa3-49a8-8805-03fdb89d0cfb HTTP/1.1" status: 200 len: 918 time: 0.1360171 Aug 24 03:06:19.494084 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-e6efeaee-92c1-40d4-9a88-1cb74f588287 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 HTTP/1.1" status: 200 len: 1000 time: 0.0649636 Aug 24 03:06:19.545634 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-7cd9b163-0fc1-4390-b071-96d24b9a7af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:19.547024 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-7cd9b163-0fc1-4390-b071-96d24b9a7af5 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=465e9b83-ccde-4ea3-8e80-86590891b03c HTTP/1.1" status: 200 len: 856 time: 0.0454149 Aug 24 03:06:19.840606 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-47d82356-8b04-4b74-978e-f1dfec0737d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:19.842122 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-47d82356-8b04-4b74-978e-f1dfec0737d3 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=72400947-ffa3-49a8-8805-03fdb89d0cfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2881105 Aug 24 03:06:19.934134 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-69b7b452-139b-49f1-96cb-74900c723948 service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817745 Aug 24 03:06:20.035982 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-004b4071-b1a3-4aa2-b0e7-fa9170e38469 req-751665b9-aa93-4c7a-81ef-31030a6ae50d service neutron] 10.222.0.43 "GET /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0938916 Aug 24 03:06:20.525996 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65c5f477-6b1a-41c7-9cdc-5e5246802345 req-2d79e5e8-4d8b-4d4d-ab45-03ff214832e1 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:20.530158 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-65c5f477-6b1a-41c7-9cdc-5e5246802345 req-2d79e5e8-4d8b-4d4d-ab45-03ff214832e1 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0561023 Aug 24 03:06:20.575497 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-65c5f477-6b1a-41c7-9cdc-5e5246802345 req-8b104965-039b-48d4-ab77-597357236c53 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406854 Aug 24 03:06:21.431924 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-fdd0303f-4a11-4fcf-ae70-fecbe7113e8c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:21.507110 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39200) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:21.743120 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f32e5e-6569-43d5-ae7b-fbdcbeccc35d req-741bf557-78fc-4ac7-9ce1-3eadc9ca4bd8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:21.744847 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-45f32e5e-6569-43d5-ae7b-fbdcbeccc35d req-741bf557-78fc-4ac7-9ce1-3eadc9ca4bd8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0624352 Aug 24 03:06:21.802334 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-45f32e5e-6569-43d5-ae7b-fbdcbeccc35d req-b86ad571-2bd6-4adb-b3ab-511934c7a3f2 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451164 Aug 24 03:06:22.058082 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3211ac0c-caec-4486-844a-5a9d815d7cfb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-566649'] for router_interface, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:22.313836 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-3211ac0c-caec-4486-844a-5a9d815d7cfb admin admin] Deleting port fe2b62d4-7d80-4b4b-9feb-2311eacbac90 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:06:22.314085 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3211ac0c-caec-4486-844a-5a9d815d7cfb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:22.390144 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-3211ac0c-caec-4486-844a-5a9d815d7cfb admin admin] For port fe2b62d4-7d80-4b4b-9feb-2311eacbac90, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=fe2b62d4-7d80-4b4b-9feb-2311eacbac90,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:06:22.390507 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3211ac0c-caec-4486-844a-5a9d815d7cfb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:22.404787 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-3211ac0c-caec-4486-844a-5a9d815d7cfb admin admin] Calling delete_port for fe2b62d4-7d80-4b4b-9feb-2311eacbac90 owned by network:router_interface {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:06:22.654231 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3211ac0c-caec-4486-844a-5a9d815d7cfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:22.679760 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3211ac0c-caec-4486-844a-5a9d815d7cfb admin admin] Pushing event deleted for resources: {'Port': ['ID=fe2b62d4-7d80-4b4b-9feb-2311eacbac90,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:22.872453 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3211ac0c-caec-4486-844a-5a9d815d7cfb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-748285', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-566109'] for router_interface, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:23.288557 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeec3fcf-58fb-4a0b-ad8e-c77cb1dd8611 req-6e0e4d97-bb1e-43fb-bbdc-736d8cf30e11 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:23.290026 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-eeec3fcf-58fb-4a0b-ad8e-c77cb1dd8611 req-6e0e4d97-bb1e-43fb-bbdc-736d8cf30e11 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.3632660 Aug 24 03:06:23.376149 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-eeec3fcf-58fb-4a0b-ad8e-c77cb1dd8611 req-c83ae306-c018-430a-bebe-f473ba2d76f2 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0783417 Aug 24 03:06:23.444968 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3211ac0c-caec-4486-844a-5a9d815d7cfb admin admin] Router 893a8671-6102-43da-9368-0f66640f4cf7 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:06:23.557557 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3211ac0c-caec-4486-844a-5a9d815d7cfb admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:06:23.563117 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-3211ac0c-caec-4486-844a-5a9d815d7cfb admin admin] 10.222.0.30 "PUT /v2.0/routers/893a8671-6102-43da-9368-0f66640f4cf7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0549996 Aug 24 03:06:23.565701 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39216) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:23.568392 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5a109c0-0682-4ad2-81a0-92b962780ae4 None None] Sync routers for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:06:23.578794 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5a109c0-0682-4ad2-81a0-92b962780ae4 None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:06:23.579413 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-d5a109c0-0682-4ad2-81a0-92b962780ae4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:05:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:23.666634 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Notify callbacks [] for router, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:23.688400 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-d5a109c0-0682-4ad2-81a0-92b962780ae4 None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:06:23.775717 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:23.902062 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Deleting port be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:06:23.902330 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:23.910491 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-d5a109c0-0682-4ad2-81a0-92b962780ae4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152'}], 'enable_snat': True}, 'gw_port_id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T03:06:22Z', 'revision_number': 5, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port': {'id': 'be1edf4f-8cf4-4e5b-81a3-e3658ebfc417', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:63:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '893a8671-6102-43da-9368-0f66640f4cf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.152', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T02:59:28Z', 'updated_at': '2021-08-24T02:59:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:23.937525 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5a109c0-0682-4ad2-81a0-92b962780ae4 None None] Checking router: 893a8671-6102-43da-9368-0f66640f4cf7 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:06:23.958512 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5a109c0-0682-4ad2-81a0-92b962780ae4 None None] Routers {'893a8671-6102-43da-9368-0f66640f4cf7'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:06:23.960611 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-d5a109c0-0682-4ad2-81a0-92b962780ae4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:05:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['893a8671-6102-43da-9368-0f66640f4cf7'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:24.005639 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-964f4d6a-6cd2-4dcf-8762-4842b30ae0cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:24.010983 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] For port be1edf4f-8cf4-4e5b-81a3-e3658ebfc417, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=be1edf4f-8cf4-4e5b-81a3-e3658ebfc417,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:06:24.011399 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:24.024701 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Calling delete_port for be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 owned by network:router_gateway {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:06:24.072490 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-d5a109c0-0682-4ad2-81a0-92b962780ae4 None None] Set router 893a8671-6102-43da-9368-0f66640f4cf7 gateway port host: None {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:06:24.137941 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-d5a109c0-0682-4ad2-81a0-92b962780ae4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T03:06:23Z', 'revision_number': 6, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port_host': None}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:24.175367 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5a109c0-0682-4ad2-81a0-92b962780ae4 None None] The sync data for ids ['893a8671-6102-43da-9368-0f66640f4cf7'] in dv-cinder-803748-8-iscsi is: [{'id': '893a8671-6102-43da-9368-0f66640f4cf7', 'name': 'tempest-AttachVolumeTestJSON-585236505-router', 'tenant_id': '7e23b688defc49bc8fa4cf796a1bc390', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T02:59:27Z', 'updated_at': '2021-08-24T03:06:23Z', 'revision_number': 6, 'project_id': '7e23b688defc49bc8fa4cf796a1bc390', 'gw_port_host': None}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:06:24.328580 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:24.357852 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:24.358491 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Pushing event deleted for resources: {'Port': ['ID=be1edf4f-8cf4-4e5b-81a3-e3658ebfc417,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:24.432842 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-569567'] for router_gateway, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:24.509587 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e4c87af-e0da-4e4e-a7f1-a06fa8e08066 req-1fe3cda4-ec4c-4628-b2ad-eebda5d776bc tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:24.511683 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2e4c87af-e0da-4e4e-a7f1-a06fa8e08066 req-1fe3cda4-ec4c-4628-b2ad-eebda5d776bc tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0505085 Aug 24 03:06:24.578465 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2e4c87af-e0da-4e4e-a7f1-a06fa8e08066 req-562871d8-e65e-4212-b827-7807e0b6183c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0504038 Aug 24 03:06:24.600931 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-560207', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32699'] for router, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:24.603330 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:24.739741 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557756'] for router, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:24.740594 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 893a8671-6102-43da-9368-0f66640f4cf7 {{(pid=111275) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Aug 24 03:06:24.746418 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] Notify callbacks [] for router, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:24.747538 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-ddcb0b4a-6ee8-48c4-bb32-8d5a559b0319 admin admin] 10.222.0.30 "DELETE /v2.0/routers/893a8671-6102-43da-9368-0f66640f4cf7 HTTP/1.1" status: 204 len: 168 time: 1.1809409 Aug 24 03:06:24.750004 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39224) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:24.792772 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-72f6c5fb-11c8-4d7a-ab12-d729e9063cac admin admin] Deleting subnet 14102a94-a55b-43e1-a7a9-4210a4c2e2fb {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:06:24.795986 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-72f6c5fb-11c8-4d7a-ab12-d729e9063cac admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:24.830791 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-72f6c5fb-11c8-4d7a-ab12-d729e9063cac admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:24.943937 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-72f6c5fb-11c8-4d7a-ab12-d729e9063cac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:25.083100 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-72f6c5fb-11c8-4d7a-ab12-d729e9063cac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:25.103824 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-72f6c5fb-11c8-4d7a-ab12-d729e9063cac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:25.108977 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc346a54-005c-4b68-a6eb-6a2d08abc63b None None] Network f35e751d-f371-4788-abda-6a58b8a779df requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:06:25.110668 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-72f6c5fb-11c8-4d7a-ab12-d729e9063cac admin admin] 10.222.0.30 "DELETE /v2.0/subnets/14102a94-a55b-43e1-a7a9-4210a4c2e2fb HTTP/1.1" status: 204 len: 168 time: 0.3594897 Aug 24 03:06:25.113022 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 39226) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:25.148516 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72f6c5fb-11c8-4d7a-ab12-d729e9063cac admin admin] Pushing event deleted for resources: {'Subnet': ['ID=14102a94-a55b-43e1-a7a9-4210a4c2e2fb,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:25.214582 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:25.224684 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device fe2b62d4-7d80-4b4b-9feb-2311eacbac90 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:06:25.248967 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: fe2b62d4-7d80-4b4b-9feb-2311eacbac90 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:06:25.249609 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device fe2b62d4-7d80-4b4b-9feb-2311eacbac90 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:06:25.250170 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:06:25.285438 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:06:25.285819 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device be1edf4f-8cf4-4e5b-81a3-e3658ebfc417 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:06:25.311479 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Deleting port eedba570-33dc-438c-a160-8ad01da54f58 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:06:25.312608 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:25.424599 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] For port eedba570-33dc-438c-a160-8ad01da54f58, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=eedba570-33dc-438c-a160-8ad01da54f58,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:06:25.425018 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:25.427541 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c741d8e-e369-48c3-8ac5-3e7b5222a8b7 None None] DHCP port deletion for f35e751d-f371-4788-abda-6a58b8a779df request from dv-cinder-803748-8-iscsi {{(pid=111277) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Aug 24 03:06:25.443748 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Calling delete_port for eedba570-33dc-438c-a160-8ad01da54f58 owned by network:dhcp {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:06:25.514559 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-9c741d8e-e369-48c3-8ac5-3e7b5222a8b7 None None] Deleting port eedba570-33dc-438c-a160-8ad01da54f58 {{(pid=111277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:06:25.514946 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9c741d8e-e369-48c3-8ac5-3e7b5222a8b7 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:25.628505 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-9c741d8e-e369-48c3-8ac5-3e7b5222a8b7 None None] For port eedba570-33dc-438c-a160-8ad01da54f58, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=eedba570-33dc-438c-a160-8ad01da54f58,segment=NetworkSegment(6f363f36-ab44-420b-9a62-ff7330e4d1b0),segment_id=6f363f36-ab44-420b-9a62-ff7330e4d1b0)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:06:25.628505 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9c741d8e-e369-48c3-8ac5-3e7b5222a8b7 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:25.628505 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-9c741d8e-e369-48c3-8ac5-3e7b5222a8b7 None None] Calling delete_port for eedba570-33dc-438c-a160-8ad01da54f58 owned by network:dhcp {{(pid=111277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:06:25.725850 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d000e54b-feb0-4b84-aa98-5fd23201e177 req-492907bb-7940-4b54-8cda-89748870d657 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:25.727890 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d000e54b-feb0-4b84-aa98-5fd23201e177 req-492907bb-7940-4b54-8cda-89748870d657 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0891023 Aug 24 03:06:25.799789 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d000e54b-feb0-4b84-aa98-5fd23201e177 req-4786c462-10d8-4496-926c-f70412d05d60 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0641229 Aug 24 03:06:26.207989 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:26.266101 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:26.290019 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9c741d8e-e369-48c3-8ac5-3e7b5222a8b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054'] for port, after_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:26.295409 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Pushing event deleted for resources: {'Port': ['ID=eedba570-33dc-438c-a160-8ad01da54f58,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:26.304380 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] No DVR routers for this DVR port eedba570-33dc-438c-a160-8ad01da54f58 on host dv-cinder-803748-8-iscsi {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:06:26.321921 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c741d8e-e369-48c3-8ac5-3e7b5222a8b7 None None] Pushing event deleted for resources: {'Port': ['ID=eedba570-33dc-438c-a160-8ad01da54f58,revision_number=None']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:26.329633 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c741d8e-e369-48c3-8ac5-3e7b5222a8b7 None None] No DVR routers for this DVR port eedba570-33dc-438c-a160-8ad01da54f58 on host dv-cinder-803748-8-iscsi {{(pid=111277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:06:26.390699 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:26.400187 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f35e751d-f371-4788-abda-6a58b8a779df']}} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:26.410357 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f363f36-ab44-420b-9a62-ff7330e4d1b0') {'for_net_delete': True} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:26.410653 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f363f36-ab44-420b-9a62-ff7330e4d1b0') {} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:06:26.419169 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25761368'] for segment, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:26.432317 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:26.438475 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Releasing vlan 355 on physical network physnet1 to pool {{(pid=111276) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:06:26.438857 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3525699'] for segment, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: Traceback (most recent call last): Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: timer() Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: cb(*args, **kw) Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: return func(*args, **kwargs) Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: self._notify() Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: self.callback(batched_events) Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: event.method(event) Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: return f(self, *a, **k) Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._get(url).json() Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: return self.request(url, 'GET', **kwargs) Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:06:26.440420 dv-cinder-803748-8-iscsi neutron-server[111276]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:06:26.587119 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:26.596188 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:26.598109 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] 10.222.0.30 "DELETE /v2.0/networks/f35e751d-f371-4788-abda-6a58b8a779df HTTP/1.1" status: 204 len: 168 time: 1.4836648 Aug 24 03:06:26.610469 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f867eac-afff-479c-b0d9-d50f1a03ef59 admin admin] Pushing event deleted for resources: {'Network': ['ID=f35e751d-f371-4788-abda-6a58b8a779df,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:26.931979 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39238) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:26.940166 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:26.941480 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1acd564f-bbe8-450f-ade2-239afc540d12 req-4006a84d-4f69-4847-8652-7a96578c9acf tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:26.943389 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1acd564f-bbe8-450f-ade2-239afc540d12 req-4006a84d-4f69-4847-8652-7a96578c9acf tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0647283 Aug 24 03:06:26.976972 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-cabfa831-0ca7-4835-afd5-fc47eaddcf48 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=7e23b688defc49bc8fa4cf796a1bc390&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0434854 Aug 24 03:06:26.980548 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 39240) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:27.000581 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1acd564f-bbe8-450f-ade2-239afc540d12 req-c3f6c771-1f58-4a91-b012-35588dbae643 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0472527 Aug 24 03:06:27.035248 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ef5efeb8-e61b-46ae-887b-28e21ac78419 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:27.064404 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ef5efeb8-e61b-46ae-887b-28e21ac78419 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:27.105030 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device eedba570-33dc-438c-a160-8ad01da54f58 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:06:27.120701 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: eedba570-33dc-438c-a160-8ad01da54f58 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:06:27.121052 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device eedba570-33dc-438c-a160-8ad01da54f58 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:06:27.202793 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ef5efeb8-e61b-46ae-887b-28e21ac78419 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:27.205367 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ef5efeb8-e61b-46ae-887b-28e21ac78419 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:27.209216 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-ef5efeb8-e61b-46ae-887b-28e21ac78419 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/a4150c95-1c17-43af-82c9-d0a877589922 HTTP/1.1" status: 204 len: 168 time: 0.2276130 Aug 24 03:06:27.218081 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef5efeb8-e61b-46ae-887b-28e21ac78419 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4150c95-1c17-43af-82c9-d0a877589922,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:28.141067 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-795b99e5-88fb-46de-8750-59a91881890e req-d37aaa35-5c56-4548-ad6b-0a59723083b3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:28.142686 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-795b99e5-88fb-46de-8750-59a91881890e req-d37aaa35-5c56-4548-ad6b-0a59723083b3 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0491080 Aug 24 03:06:28.204121 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-795b99e5-88fb-46de-8750-59a91881890e req-2b47472f-dd24-4244-b719-baa4cb5f62d4 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0534761 Aug 24 03:06:29.334856 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c6bcaad-9f2a-4966-948c-a869f76dd43e req-284f1601-2ba1-474f-8720-bee5d5663960 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:29.338150 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6c6bcaad-9f2a-4966-948c-a869f76dd43e req-284f1601-2ba1-474f-8720-bee5d5663960 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0545039 Aug 24 03:06:29.379977 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6c6bcaad-9f2a-4966-948c-a869f76dd43e req-1c4c4968-b380-46df-9d62-a8fa2f1db600 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0369833 Aug 24 03:06:29.567520 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:06:30.514935 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2692699-e0f5-4280-96b0-0da9f67d3aff req-766fc7a7-5c17-4c63-b311-f76f2b65caf1 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:30.516446 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a2692699-e0f5-4280-96b0-0da9f67d3aff req-766fc7a7-5c17-4c63-b311-f76f2b65caf1 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0569303 Aug 24 03:06:30.560848 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a2692699-e0f5-4280-96b0-0da9f67d3aff req-a4e283ca-968b-4dda-9992-940aabf49b5d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0372291 Aug 24 03:06:31.684706 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a5ebbd7-6171-4c5c-aa3d-c7a9e45b87e2 req-0d866a83-c81a-47cb-8ec1-21726adeadf0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:31.686255 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9a5ebbd7-6171-4c5c-aa3d-c7a9e45b87e2 req-0d866a83-c81a-47cb-8ec1-21726adeadf0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0527747 Aug 24 03:06:31.723304 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9a5ebbd7-6171-4c5c-aa3d-c7a9e45b87e2 req-dab9a758-35d7-471f-a1e9-ca2642913d4b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0311465 Aug 24 03:06:32.475977 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 39394) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:32.588753 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0caa3457-7340-4bcd-a2a0-0ed6acaf6c02 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:32.678007 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0caa3457-7340-4bcd-a2a0-0ed6acaf6c02 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:32.756873 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0caa3457-7340-4bcd-a2a0-0ed6acaf6c02 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:32.793907 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-0caa3457-7340-4bcd-a2a0-0ed6acaf6c02 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=16a59b6d42c84faa8f0689f34c03adf8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3168211 Aug 24 03:06:32.797771 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39420) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:32.800774 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0caa3457-7340-4bcd-a2a0-0ed6acaf6c02 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=10c1461d-19f5-44ba-a2d1-c779ac1ce945,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:32.898578 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54383347-bad2-4d07-b939-1e8b51594493 req-fcd01bb2-6fdc-4dfe-99ae-7a66af06a6b0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:32.900067 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-54383347-bad2-4d07-b939-1e8b51594493 req-fcd01bb2-6fdc-4dfe-99ae-7a66af06a6b0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0840921 Aug 24 03:06:32.905513 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8125bb3d-d0dc-4087-bda0-fc36eeb8fbe4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:32.943742 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8125bb3d-d0dc-4087-bda0-fc36eeb8fbe4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:32.971402 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-54383347-bad2-4d07-b939-1e8b51594493 req-47c7d0e4-d9ab-4c86-8ba6-e105556ac09f tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0634081 Aug 24 03:06:33.082025 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8125bb3d-d0dc-4087-bda0-fc36eeb8fbe4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:33.084608 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8125bb3d-d0dc-4087-bda0-fc36eeb8fbe4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:33.085789 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-8125bb3d-d0dc-4087-bda0-fc36eeb8fbe4 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/10c1461d-19f5-44ba-a2d1-c779ac1ce945 HTTP/1.1" status: 204 len: 168 time: 0.2869506 Aug 24 03:06:33.093548 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8125bb3d-d0dc-4087-bda0-fc36eeb8fbe4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10c1461d-19f5-44ba-a2d1-c779ac1ce945,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:33.733435 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39452) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:33.838379 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe31419d-c17c-4529-af47-3f771814fa89 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:33.926903 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe31419d-c17c-4529-af47-3f771814fa89 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:34.019427 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fe31419d-c17c-4529-af47-3f771814fa89 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:34.065524 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-fe31419d-c17c-4529-af47-3f771814fa89 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=90028ed694da42fe8237f79959157c83&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3309233 Aug 24 03:06:34.066264 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39466) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:34.066875 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe31419d-c17c-4529-af47-3f771814fa89 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=42ec4888-78a4-4d03-89a5-977e2e32635d,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:34.100136 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11628d2d-5df1-4d35-b379-bdf382395039 req-80dd05e1-d6d7-472f-a7d2-8625252c222a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:34.104416 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11628d2d-5df1-4d35-b379-bdf382395039 req-80dd05e1-d6d7-472f-a7d2-8625252c222a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 944 time: 0.0554321 Aug 24 03:06:34.130049 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e8130bfe-d5dc-42af-8179-73d24b95a0e5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:34.143954 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-11628d2d-5df1-4d35-b379-bdf382395039 req-a69c5e9b-13eb-4421-b569-19a9345ff2ca tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0353355 Aug 24 03:06:34.152221 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e8130bfe-d5dc-42af-8179-73d24b95a0e5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:34.206163 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:06:34.288370 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e8130bfe-d5dc-42af-8179-73d24b95a0e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:34.291134 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e8130bfe-d5dc-42af-8179-73d24b95a0e5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:34.292304 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-e8130bfe-d5dc-42af-8179-73d24b95a0e5 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/42ec4888-78a4-4d03-89a5-977e2e32635d HTTP/1.1" status: 204 len: 168 time: 0.2226334 Aug 24 03:06:34.300621 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8130bfe-d5dc-42af-8179-73d24b95a0e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=42ec4888-78a4-4d03-89a5-977e2e32635d,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:34.315438 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:06:34.332993 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'port_id': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'mac_address': 'fa:16:3e:0a:41:69', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 356, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:06:34.372651 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:34.387293 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:06:34.413609 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:06:34.522456 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:34.572608 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,revision_number=9']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:34.734091 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:06:34.892969 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39484) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:34.905991 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c87174ea-0c25-4896-a569-9a34d0510e6d admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:35.000684 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c87174ea-0c25-4896-a569-9a34d0510e6d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:35.082294 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c87174ea-0c25-4896-a569-9a34d0510e6d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:35.118449 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c87174ea-0c25-4896-a569-9a34d0510e6d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f0cf0a98-321c-415d-9f96-633d1db93a40,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:35.124150 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-c87174ea-0c25-4896-a569-9a34d0510e6d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=bfd8d2162edb47f286683b312ae2e716&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2295344 Aug 24 03:06:35.126957 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39490) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:35.177279 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-92df416c-a605-4c0e-add7-7a4c93c41385 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:35.198453 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-92df416c-a605-4c0e-add7-7a4c93c41385 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:35.266997 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4931c75a-5966-47b7-92d0-21feca294049 req-64afd424-5856-40dd-8887-a7d6fa755ac5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:35.268474 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4931c75a-5966-47b7-92d0-21feca294049 req-64afd424-5856-40dd-8887-a7d6fa755ac5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 945 time: 0.0520809 Aug 24 03:06:35.309330 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4931c75a-5966-47b7-92d0-21feca294049 req-4c758491-9878-4e47-ad18-bace101e04a2 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0348356 Aug 24 03:06:35.339376 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-92df416c-a605-4c0e-add7-7a4c93c41385 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:35.342917 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-92df416c-a605-4c0e-add7-7a4c93c41385 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:35.344044 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-92df416c-a605-4c0e-add7-7a4c93c41385 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/f0cf0a98-321c-415d-9f96-633d1db93a40 HTTP/1.1" status: 204 len: 168 time: 0.2168775 Aug 24 03:06:35.351845 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92df416c-a605-4c0e-add7-7a4c93c41385 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0cf0a98-321c-415d-9f96-633d1db93a40,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:35.486165 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ed269a-96b3-42e7-9c4c-e2f9764c8388 req-94926013-a6b1-43f0-9e9a-a221dfe33f50 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:35.489866 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e5ed269a-96b3-42e7-9c4c-e2f9764c8388 req-94926013-a6b1-43f0-9e9a-a221dfe33f50 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0504701 Aug 24 03:06:35.525934 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e5ed269a-96b3-42e7-9c4c-e2f9764c8388 req-7d89c87e-457d-4d46-9521-c343783e3a0b tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0323060 Aug 24 03:06:36.222500 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:06:36.275523 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:06:36.275892 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:36.351594 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:36.375007 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:06:36.377344 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef485fbc-d402-419d-9751-b3dbc14f6f91" -d '{"events": [{"server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "name": "network-vif-plugged", "status": "completed", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:06:36.391426 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:06:36.427492 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:06:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc583b38-d4f5-4237-81a6-d4ed034568f4 x-openstack-request-id: req-bc583b38-d4f5-4237-81a6-d4ed034568f4 {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:06:36.427782 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "name": "network-vif-plugged", "status": "completed", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:06:36.428028 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-bc583b38-d4f5-4237-81a6-d4ed034568f4 {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:06:36.428412 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'code': 200} Aug 24 03:06:36.448966 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e67217-509d-43c0-b06b-3e86693b89f3 req-2e4fe1a8-2eaa-4a32-be92-d9f76bd9c1e9 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:36.451307 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-49e67217-509d-43c0-b06b-3e86693b89f3 req-2e4fe1a8-2eaa-4a32-be92-d9f76bd9c1e9 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 945 time: 0.0547123 Aug 24 03:06:36.466238 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:36.510303 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-49e67217-509d-43c0-b06b-3e86693b89f3 req-9cce1e2e-f287-423c-bb44-7e9954e869e8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0521462 Aug 24 03:06:36.521166 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,revision_number=10']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:36.666358 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b30db91f-41ed-42c1-8d33-94a389eff7f3 req-bbebb963-7cb4-4e9c-8aec-1f3d5e82e3ee tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:36.668416 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b30db91f-41ed-42c1-8d33-94a389eff7f3 req-bbebb963-7cb4-4e9c-8aec-1f3d5e82e3ee tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0593104 Aug 24 03:06:36.706302 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b30db91f-41ed-42c1-8d33-94a389eff7f3 req-0a942895-9a54-4f85-b605-678787e9bea9 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0316663 Aug 24 03:06:36.756995 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa37fd5-9dfe-4bd3-ac6a-74871027755a req-1b4789a2-3758-4de0-b024-37421211da5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:36.758529 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bfa37fd5-9dfe-4bd3-ac6a-74871027755a req-1b4789a2-3758-4de0-b024-37421211da5a service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 1100 time: 0.0444670 Aug 24 03:06:36.794374 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bfa37fd5-9dfe-4bd3-ac6a-74871027755a req-6dd1e280-700d-4864-b9e5-af7dcfda1140 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0282795 Aug 24 03:06:37.639229 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92c6e3b-6a86-4a6e-84e9-3181466b230b req-9b358b3d-5efc-4f93-a351-fc11f52a12db tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:37.641279 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a92c6e3b-6a86-4a6e-84e9-3181466b230b req-9b358b3d-5efc-4f93-a351-fc11f52a12db tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 947 time: 0.0505762 Aug 24 03:06:37.678823 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a92c6e3b-6a86-4a6e-84e9-3181466b230b req-173c0260-6d4e-44b2-8d35-26c6df74f7d5 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0317283 Aug 24 03:06:37.825406 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c104fc16-f048-44f2-827f-39ec64a78fc0 req-08497ad0-b2ce-4aa8-a3ca-e889dd9d5321 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:37.827018 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c104fc16-f048-44f2-827f-39ec64a78fc0 req-08497ad0-b2ce-4aa8-a3ca-e889dd9d5321 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0495799 Aug 24 03:06:37.856903 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39574) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:37.877145 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c104fc16-f048-44f2-827f-39ec64a78fc0 req-f5a4e1f1-8a48-453c-9b66-e284a5bc222d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433471 Aug 24 03:06:37.972742 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:38.073141 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:38.162044 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:38.202640 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=134c90a8146a4f68a8f8347afe6086e8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3444295 Aug 24 03:06:38.203589 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88be2f45-2b41-4f8d-95c0-6797647a4d60,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:38.205301 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 39594) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:38.211398 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:38.211680 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:38.212057 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:38.212764 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:38.213174 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:38.213428 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:38.213908 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:38.214095 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:38.214419 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:38.214739 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:38.215091 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:38.215365 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c1e098b-0810-4dbb-96b9-e87e24caff81 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:06:38.263574 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a6294a4a-cdb6-4752-8fcc-93414245b43f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:38.284969 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a6294a4a-cdb6-4752-8fcc-93414245b43f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:38.431298 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a6294a4a-cdb6-4752-8fcc-93414245b43f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:38.433917 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a6294a4a-cdb6-4752-8fcc-93414245b43f admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:38.435261 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-a6294a4a-cdb6-4752-8fcc-93414245b43f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/88be2f45-2b41-4f8d-95c0-6797647a4d60 HTTP/1.1" status: 204 len: 168 time: 0.2288573 Aug 24 03:06:38.443146 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6294a4a-cdb6-4752-8fcc-93414245b43f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88be2f45-2b41-4f8d-95c0-6797647a4d60,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:38.659325 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:38.802659 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74debf62-f154-4c27-8146-5db87c210fd6 req-cbf74248-8ccc-47be-b149-1e3c83d2d3ca tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:38.804162 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-74debf62-f154-4c27-8146-5db87c210fd6 req-cbf74248-8ccc-47be-b149-1e3c83d2d3ca tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 947 time: 0.0529029 Aug 24 03:06:38.844733 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-74debf62-f154-4c27-8146-5db87c210fd6 req-4f136134-30f7-42c9-99bd-f81c3e9ed241 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0334039 Aug 24 03:06:39.003938 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d88df047-4d73-4fc2-9798-bf4f4e4b0a83 req-4cd3a09a-c89a-42bb-8eca-ea68fd219762 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:39.005430 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d88df047-4d73-4fc2-9798-bf4f4e4b0a83 req-4cd3a09a-c89a-42bb-8eca-ea68fd219762 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0523968 Aug 24 03:06:39.042700 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d88df047-4d73-4fc2-9798-bf4f4e4b0a83 req-01fbbb9d-99ff-485e-8a44-dcc0692055de tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0311964 Aug 24 03:06:39.267271 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 39632) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:39.281178 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-14073edf-bf77-43c6-82dc-31fcc7ebadc2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:39.372083 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-14073edf-bf77-43c6-82dc-31fcc7ebadc2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:39.477701 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-14073edf-bf77-43c6-82dc-31fcc7ebadc2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:39.514816 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14073edf-bf77-43c6-82dc-31fcc7ebadc2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2639b0d5-3efb-4f9c-ad2d-82353fa47e98,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:39.519162 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-14073edf-bf77-43c6-82dc-31fcc7ebadc2 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=1e144927b041482fa58e3cf53cac4d7c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2508478 Aug 24 03:06:39.522190 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 39634) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:39.570579 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ab1fb698-30d2-4380-9e0e-a773326ace2a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:39.594624 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ab1fb698-30d2-4380-9e0e-a773326ace2a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:39.796357 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ab1fb698-30d2-4380-9e0e-a773326ace2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:39.799204 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ab1fb698-30d2-4380-9e0e-a773326ace2a admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:39.800460 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-ab1fb698-30d2-4380-9e0e-a773326ace2a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2639b0d5-3efb-4f9c-ad2d-82353fa47e98 HTTP/1.1" status: 204 len: 168 time: 0.2777824 Aug 24 03:06:39.808947 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab1fb698-30d2-4380-9e0e-a773326ace2a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2639b0d5-3efb-4f9c-ad2d-82353fa47e98,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:39.980125 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60ef0a44-8d5a-4a0e-9bfa-6fb712c665d9 req-d0d14ecb-53e8-4384-acb3-d88b49cfafa0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:39.982246 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-60ef0a44-8d5a-4a0e-9bfa-6fb712c665d9 req-d0d14ecb-53e8-4384-acb3-d88b49cfafa0 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 947 time: 0.0500813 Aug 24 03:06:40.024289 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-60ef0a44-8d5a-4a0e-9bfa-6fb712c665d9 req-d0e62502-f71c-4206-bca6-309055526d41 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0358913 Aug 24 03:06:40.157030 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3dfd300-1c67-4720-a16d-0ec7c7780d63 req-ac8e790d-538a-4acc-8777-b93459fa4123 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:40.158572 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3dfd300-1c67-4720-a16d-0ec7c7780d63 req-ac8e790d-538a-4acc-8777-b93459fa4123 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0481820 Aug 24 03:06:40.203309 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b3dfd300-1c67-4720-a16d-0ec7c7780d63 req-3fd49d3c-e39d-4d77-b0e5-250ec656caaf tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0383251 Aug 24 03:06:40.587637 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a87328-8cb5-4601-9c4d-d163b437d4fc req-d3b17153-cae7-4abe-8966-99b7dd6c3d9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:40.589150 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e8a87328-8cb5-4601-9c4d-d163b437d4fc req-d3b17153-cae7-4abe-8966-99b7dd6c3d9c service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=8bca2ab0549a4f099c2421571c26f61b&device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 1098 time: 0.0399387 Aug 24 03:06:40.706383 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a87328-8cb5-4601-9c4d-d163b437d4fc req-f97f0963-4ac2-41d3-a1a3-1fbfdeaeca8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:40.707857 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e8a87328-8cb5-4601-9c4d-d163b437d4fc req-f97f0963-4ac2-41d3-a1a3-1fbfdeaeca8e service neutron] 10.222.0.43 "GET /v2.0/networks?id=866d4604-551e-4da3-b89c-967338dbafff HTTP/1.1" status: 200 len: 910 time: 0.0951519 Aug 24 03:06:40.776530 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e8a87328-8cb5-4601-9c4d-d163b437d4fc req-bbab0034-7c87-439b-b96b-b976f5a192f3 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09 HTTP/1.1" status: 200 len: 1001 time: 0.0605669 Aug 24 03:06:40.825204 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a87328-8cb5-4601-9c4d-d163b437d4fc req-ec7c1e41-bd68-4f09-a920-1009c1027fb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:40.827025 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e8a87328-8cb5-4601-9c4d-d163b437d4fc req-ec7c1e41-bd68-4f09-a920-1009c1027fb3 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4ffb6451-69cb-476e-bc2e-5b6165a067b1 HTTP/1.1" status: 200 len: 848 time: 0.0439425 Aug 24 03:06:40.877371 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a87328-8cb5-4601-9c4d-d163b437d4fc req-19bb72f6-df81-41cd-ac29-a2a63bad762b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:40.878905 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e8a87328-8cb5-4601-9c4d-d163b437d4fc req-19bb72f6-df81-41cd-ac29-a2a63bad762b service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=866d4604-551e-4da3-b89c-967338dbafff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0447142 Aug 24 03:06:40.967427 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e8a87328-8cb5-4601-9c4d-d163b437d4fc req-5fc0a679-4fcc-4018-8597-1651cea8e1ed service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811117 Aug 24 03:06:41.062065 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e8a87328-8cb5-4601-9c4d-d163b437d4fc req-f2d6e8b7-4a7a-4679-8540-fa50d5c38a98 service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866644 Aug 24 03:06:41.318579 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d477f761-e70f-4a59-ae53-2373b015bd8d req-ddf24038-f3b4-4698-b474-6ebe5da1db00 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:41.320087 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d477f761-e70f-4a59-ae53-2373b015bd8d req-ddf24038-f3b4-4698-b474-6ebe5da1db00 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0507638 Aug 24 03:06:41.360225 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d477f761-e70f-4a59-ae53-2373b015bd8d req-c2bb7abf-58da-4508-9039-a9931255cc1b tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0337079 Aug 24 03:06:42.476058 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5847c78a-c734-4d43-b70a-2cd3ba1f8bc1 req-809e5b68-ebfb-4d99-8d42-443eed99d60d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:42.477515 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5847c78a-c734-4d43-b70a-2cd3ba1f8bc1 req-809e5b68-ebfb-4d99-8d42-443eed99d60d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0507584 Aug 24 03:06:42.515261 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5847c78a-c734-4d43-b70a-2cd3ba1f8bc1 req-89d43a10-881c-4027-9846-b1c51b76f3f8 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0315304 Aug 24 03:06:43.629687 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90c1e375-1ef9-431a-9da1-2f21f9f875bd req-48b10d0c-8969-44e2-961f-f63773715334 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:43.631139 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-90c1e375-1ef9-431a-9da1-2f21f9f875bd req-48b10d0c-8969-44e2-961f-f63773715334 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0486221 Aug 24 03:06:43.668803 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-90c1e375-1ef9-431a-9da1-2f21f9f875bd req-90d01954-ad3a-4c30-87ff-2591bb4ea33c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0316935 Aug 24 03:06:44.457339 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39754) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:44.561027 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bb1d7a4a-f157-4599-986f-4754da9344f0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:44.645104 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bb1d7a4a-f157-4599-986f-4754da9344f0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:44.710614 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bb1d7a4a-f157-4599-986f-4754da9344f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:44.751949 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-bb1d7a4a-f157-4599-986f-4754da9344f0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b289a492aafb485baf8116f0da699ae8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2932639 Aug 24 03:06:44.754006 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb1d7a4a-f157-4599-986f-4754da9344f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3124bbae-d206-4e7a-ac94-722c87071262,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:44.757139 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39760) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:44.785196 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faec5488-4754-41a9-bd81-d9f12567eb0e req-8e364ee9-677d-4b2c-b6ea-98a4d580013d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:44.786675 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-faec5488-4754-41a9-bd81-d9f12567eb0e req-8e364ee9-677d-4b2c-b6ea-98a4d580013d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0505004 Aug 24 03:06:44.810389 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2b5da1d5-b017-4abf-a110-018f8b8dbcc7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:44.827491 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-faec5488-4754-41a9-bd81-d9f12567eb0e req-4f4f6873-80e8-48c9-ac3c-12ab454b44bf tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0348191 Aug 24 03:06:44.834451 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2b5da1d5-b017-4abf-a110-018f8b8dbcc7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:44.967850 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2b5da1d5-b017-4abf-a110-018f8b8dbcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:44.970475 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2b5da1d5-b017-4abf-a110-018f8b8dbcc7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:44.971639 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-2b5da1d5-b017-4abf-a110-018f8b8dbcc7 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3124bbae-d206-4e7a-ac94-722c87071262 HTTP/1.1" status: 204 len: 168 time: 0.2135661 Aug 24 03:06:44.979398 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b5da1d5-b017-4abf-a110-018f8b8dbcc7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3124bbae-d206-4e7a-ac94-722c87071262,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:45.386187 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39774) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:45.493383 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2cc85aa2-59f0-49e6-8aa8-1017a8a50358 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:45.578231 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2cc85aa2-59f0-49e6-8aa8-1017a8a50358 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:45.647750 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2cc85aa2-59f0-49e6-8aa8-1017a8a50358 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:45.680889 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3da6613-a6b3-473a-9a9f-a9662ecb39dd req-dc7e1c1a-4d95-4869-a3c0-37e811cc14ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:45.682560 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a3da6613-a6b3-473a-9a9f-a9662ecb39dd req-dc7e1c1a-4d95-4869-a3c0-37e811cc14ac service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=8bca2ab0549a4f099c2421571c26f61b&device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 1098 time: 0.0461900 Aug 24 03:06:45.691240 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-2cc85aa2-59f0-49e6-8aa8-1017a8a50358 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9273629c004c403e92d8c3ce7e895d4e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3039334 Aug 24 03:06:45.692451 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cc85aa2-59f0-49e6-8aa8-1017a8a50358 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=98fbe907-8e58-4dc6-9381-6376d83d1864,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:45.695599 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39780) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:45.746172 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b9ee505b-b2f8-4d63-8fc7-8fad449313e6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:45.766795 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b9ee505b-b2f8-4d63-8fc7-8fad449313e6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:45.776792 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3da6613-a6b3-473a-9a9f-a9662ecb39dd req-a267b284-f3ee-4777-9fc1-cb32dd785c06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:45.778662 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a3da6613-a6b3-473a-9a9f-a9662ecb39dd req-a267b284-f3ee-4777-9fc1-cb32dd785c06 service neutron] 10.222.0.43 "GET /v2.0/networks?id=866d4604-551e-4da3-b89c-967338dbafff HTTP/1.1" status: 200 len: 910 time: 0.0881193 Aug 24 03:06:45.815738 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39782) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:45.828755 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-18fcfd78-ee70-4877-94eb-699aee7a5de4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:45.850269 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a3da6613-a6b3-473a-9a9f-a9662ecb39dd req-e84338ec-32fa-4780-91d2-4bc96c29f0a6 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09 HTTP/1.1" status: 200 len: 1001 time: 0.0639124 Aug 24 03:06:45.900416 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3da6613-a6b3-473a-9a9f-a9662ecb39dd req-10b334f1-4b8b-4c8b-99bc-44e7bc25c3ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:45.901879 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a3da6613-a6b3-473a-9a9f-a9662ecb39dd req-10b334f1-4b8b-4c8b-99bc-44e7bc25c3ad service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4ffb6451-69cb-476e-bc2e-5b6165a067b1 HTTP/1.1" status: 200 len: 848 time: 0.0450850 Aug 24 03:06:45.912686 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b9ee505b-b2f8-4d63-8fc7-8fad449313e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:45.915256 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b9ee505b-b2f8-4d63-8fc7-8fad449313e6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:45.920767 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-b9ee505b-b2f8-4d63-8fc7-8fad449313e6 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/98fbe907-8e58-4dc6-9381-6376d83d1864 HTTP/1.1" status: 204 len: 168 time: 0.2197027 Aug 24 03:06:45.948267 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9ee505b-b2f8-4d63-8fc7-8fad449313e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98fbe907-8e58-4dc6-9381-6376d83d1864,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:45.949943 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3da6613-a6b3-473a-9a9f-a9662ecb39dd req-2aab0c5d-2759-4c5f-9198-a852b3848d60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:45.956334 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a3da6613-a6b3-473a-9a9f-a9662ecb39dd req-2aab0c5d-2759-4c5f-9198-a852b3848d60 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=866d4604-551e-4da3-b89c-967338dbafff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0461919 Aug 24 03:06:45.980269 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce9c1931-15dc-431c-8e4e-194c1bff0fe7 req-ac29ab72-6455-4f09-aa1c-b5f2659968d9 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:45.984220 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ce9c1931-15dc-431c-8e4e-194c1bff0fe7 req-ac29ab72-6455-4f09-aa1c-b5f2659968d9 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0856421 Aug 24 03:06:46.047437 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ce9c1931-15dc-431c-8e4e-194c1bff0fe7 req-e2dc578f-3fd3-4bc6-8169-be924e617302 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0556216 Aug 24 03:06:46.058694 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a3da6613-a6b3-473a-9a9f-a9662ecb39dd req-1dc2b0a9-d6c7-4202-9ad0-9e07c3501ae5 service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0922935 Aug 24 03:06:46.063234 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-18fcfd78-ee70-4877-94eb-699aee7a5de4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:46.144903 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-18fcfd78-ee70-4877-94eb-699aee7a5de4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:46.151088 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a3da6613-a6b3-473a-9a9f-a9662ecb39dd req-5915f281-67cc-492b-a727-c0a64b764580 service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852842 Aug 24 03:06:46.183743 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18fcfd78-ee70-4877-94eb-699aee7a5de4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60620bf9-bd3c-402b-b3f2-a7574d5a9f68,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:46.188445 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-18fcfd78-ee70-4877-94eb-699aee7a5de4 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2ccb84cee6fd4c86b0aa4952a78afb3f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3716450 Aug 24 03:06:46.191032 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39788) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:46.240564 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6d1b1bd7-9b56-4fdc-abee-37a2eede6d65 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:46.260987 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6d1b1bd7-9b56-4fdc-abee-37a2eede6d65 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:46.379325 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6d1b1bd7-9b56-4fdc-abee-37a2eede6d65 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:46.381869 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6d1b1bd7-9b56-4fdc-abee-37a2eede6d65 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:46.383087 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-6d1b1bd7-9b56-4fdc-abee-37a2eede6d65 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/60620bf9-bd3c-402b-b3f2-a7574d5a9f68 HTTP/1.1" status: 204 len: 168 time: 0.1910203 Aug 24 03:06:46.391345 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d1b1bd7-9b56-4fdc-abee-37a2eede6d65 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60620bf9-bd3c-402b-b3f2-a7574d5a9f68,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:46.676710 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39794) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:46.690638 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-42181597-1920-41f8-9b8c-d2080c143797 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:46.778033 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-42181597-1920-41f8-9b8c-d2080c143797 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:46.847691 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-42181597-1920-41f8-9b8c-d2080c143797 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:46.887310 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42181597-1920-41f8-9b8c-d2080c143797 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c1ac6e8-4528-4e62-82d0-5427e4173066,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:46.897409 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-42181597-1920-41f8-9b8c-d2080c143797 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=87079ff0318346e08f6faa3908bec196&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2157662 Aug 24 03:06:46.899612 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39802) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:46.948846 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b213ad0c-ac15-496b-8c15-2e6ff3a6851c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:46.970316 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b213ad0c-ac15-496b-8c15-2e6ff3a6851c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:47.076881 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b213ad0c-ac15-496b-8c15-2e6ff3a6851c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:47.079471 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b213ad0c-ac15-496b-8c15-2e6ff3a6851c admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:47.102644 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-b213ad0c-ac15-496b-8c15-2e6ff3a6851c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/4c1ac6e8-4528-4e62-82d0-5427e4173066 HTTP/1.1" status: 204 len: 168 time: 0.1799231 Aug 24 03:06:47.102644 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b213ad0c-ac15-496b-8c15-2e6ff3a6851c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c1ac6e8-4528-4e62-82d0-5427e4173066,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:47.167214 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e9cac4c-c10e-4b4c-b5ba-28affb73a9ae req-19482e2c-b260-418f-8fa1-c5ed778a9f82 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:47.169440 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0e9cac4c-c10e-4b4c-b5ba-28affb73a9ae req-19482e2c-b260-418f-8fa1-c5ed778a9f82 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0501637 Aug 24 03:06:47.208224 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0e9cac4c-c10e-4b4c-b5ba-28affb73a9ae req-94762661-1305-4471-8513-1469dabd4650 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0321865 Aug 24 03:06:47.840519 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 39828) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:47.859601 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a0b94308-e8f1-47ca-8f7b-51ab618a1da0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:47.953441 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a0b94308-e8f1-47ca-8f7b-51ab618a1da0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:48.036288 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-a0b94308-e8f1-47ca-8f7b-51ab618a1da0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:48.077120 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-a0b94308-e8f1-47ca-8f7b-51ab618a1da0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c9312a99f98245309f9e383c2fce71c4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2354665 Aug 24 03:06:48.078005 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0b94308-e8f1-47ca-8f7b-51ab618a1da0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e1c5c43-ac6a-472a-9adc-b51742960403,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:48.080044 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39834) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:48.130110 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f55558de-4e9d-4156-b2de-6192c0c2d3d7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:48.152965 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f55558de-4e9d-4156-b2de-6192c0c2d3d7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:48.316487 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f55558de-4e9d-4156-b2de-6192c0c2d3d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:48.319024 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-f55558de-4e9d-4156-b2de-6192c0c2d3d7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:48.320172 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-f55558de-4e9d-4156-b2de-6192c0c2d3d7 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6e1c5c43-ac6a-472a-9adc-b51742960403 HTTP/1.1" status: 204 len: 168 time: 0.2389865 Aug 24 03:06:48.342488 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d0efb11-75c6-4af2-beb3-57c6db466971 req-dc253fdc-add2-474f-a0be-246b10dcaf81 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:48.344756 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d0efb11-75c6-4af2-beb3-57c6db466971 req-dc253fdc-add2-474f-a0be-246b10dcaf81 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0697975 Aug 24 03:06:48.345660 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f55558de-4e9d-4156-b2de-6192c0c2d3d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e1c5c43-ac6a-472a-9adc-b51742960403,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:48.387642 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1d0efb11-75c6-4af2-beb3-57c6db466971 req-fc7d0741-e0b8-4932-850e-0ee286a6bb76 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0358803 Aug 24 03:06:49.505715 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c549f362-fec9-4061-8675-1c66b225f389 req-fc98f398-ed5a-4879-876e-2e80e24915aa tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:49.507171 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c549f362-fec9-4061-8675-1c66b225f389 req-fc98f398-ed5a-4879-876e-2e80e24915aa tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0490785 Aug 24 03:06:49.545755 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c549f362-fec9-4061-8675-1c66b225f389 req-93a9fbbe-62e7-489e-8d61-d6d1bcea04f9 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0322249 Aug 24 03:06:49.940545 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3a5f635-ec8c-4924-abc8-2594c8ca29fc req-3880d6ad-8a30-4453-9abf-c862833a5f78 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:49.942119 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e3a5f635-ec8c-4924-abc8-2594c8ca29fc req-3880d6ad-8a30-4453-9abf-c862833a5f78 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0524871 Aug 24 03:06:50.015196 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-7647bbca-6e31-485d-9b92-8c9da3e817a7 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0693567 Aug 24 03:06:50.024955 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e3a5f635-ec8c-4924-abc8-2594c8ca29fc req-04bc012a-0638-4708-a250-5251beca2433 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0693090 Aug 24 03:06:50.284300 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 8069cbc1-7d07-44d4-b500-7a5a4c751d09 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:06:50.359599 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:50.382051 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:06:50.384256 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-909c96f8-6894-46c1-a194-60b03ed0cb8a" -d '{"events": [{"server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "name": "network-vif-unplugged", "status": "completed", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:06:50.398104 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 8069cbc1-7d07-44d4-b500-7a5a4c751d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:06:50.418344 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 24 Aug 2021 03:06:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-496db054-24b6-472a-8b38-982cc3cca163 x-openstack-request-id: req-496db054-24b6-472a-8b38-982cc3cca163 {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:06:50.418344 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "name": "network-vif-unplugged", "status": "failed", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09", "code": 422}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:06:50.418344 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-496db054-24b6-472a-8b38-982cc3cca163 {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:06:50.418657 dv-cinder-803748-8-iscsi neutron-server[111277]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'code': 422} returned with failed status Aug 24 03:06:50.544690 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:50.592698 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=8069cbc1-7d07-44d4-b500-7a5a4c751d09,revision_number=6']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:51.134241 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea589611-d564-4504-a28c-5a0ee45b33e9 req-fb00b375-3e5f-44a5-8acf-0f34cb5d85ef tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:51.135945 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ea589611-d564-4504-a28c-5a0ee45b33e9 req-fb00b375-3e5f-44a5-8acf-0f34cb5d85ef tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0488305 Aug 24 03:06:51.175033 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ea589611-d564-4504-a28c-5a0ee45b33e9 req-29d900fe-ab38-4e01-9b71-d584f89caff3 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0319273 Aug 24 03:06:51.424894 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-d690a2bd-106d-4f95-b824-4445d0358054 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:52.292966 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ede3fc1-3109-41f3-9601-46474ed7de0f req-3d1f2e60-6c6f-4419-afd2-0582c775ceb6 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:52.294495 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9ede3fc1-3109-41f3-9601-46474ed7de0f req-3d1f2e60-6c6f-4419-afd2-0582c775ceb6 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0494466 Aug 24 03:06:52.334364 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9ede3fc1-3109-41f3-9601-46474ed7de0f req-ba8ee8ab-f8d3-4a9c-9d60-7eb8c90f44c7 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0329080 Aug 24 03:06:52.683589 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-3f9d020d-e830-4bd7-bcee-94dd5f4b2966 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:52.685206 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-3f9d020d-e830-4bd7-bcee-94dd5f4b2966 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b&tenant_id=8bca2ab0549a4f099c2421571c26f61b HTTP/1.1" status: 200 len: 1096 time: 0.0413394 Aug 24 03:06:52.750377 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-1b7dfc9c-74c1-4a74-92e0-354cdd023a5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:52.751913 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-1b7dfc9c-74c1-4a74-92e0-354cdd023a5e service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=8bca2ab0549a4f099c2421571c26f61b&device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 1096 time: 0.0441866 Aug 24 03:06:52.844832 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-6042bbe4-ef9b-4469-ab5e-0340be0ffc8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:52.846349 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-6042bbe4-ef9b-4469-ab5e-0340be0ffc8e service neutron] 10.222.0.43 "GET /v2.0/networks?id=866d4604-551e-4da3-b89c-967338dbafff HTTP/1.1" status: 200 len: 910 time: 0.0860901 Aug 24 03:06:52.918406 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-546748fa-0580-469a-80f5-5b7f2034b099 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09 HTTP/1.1" status: 200 len: 999 time: 0.0648062 Aug 24 03:06:52.969409 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-2abe9f68-1565-4113-8c2e-51326c3ebd13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:52.970950 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-2abe9f68-1565-4113-8c2e-51326c3ebd13 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4ffb6451-69cb-476e-bc2e-5b6165a067b1 HTTP/1.1" status: 200 len: 848 time: 0.0448699 Aug 24 03:06:53.017482 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-211b02ed-7659-4b41-8816-ed47f90e9259 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:53.018324 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-211b02ed-7659-4b41-8816-ed47f90e9259 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=866d4604-551e-4da3-b89c-967338dbafff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0393240 Aug 24 03:06:53.114294 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-286070bb-0a9b-48bf-b59f-936555dfed66 service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879083 Aug 24 03:06:53.214464 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ddc1b4cc-d352-4c0d-94dd-f04f5cd273c6 req-0a4ee52c-1b15-4197-b301-df30ac5a492d service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827610 Aug 24 03:06:53.449430 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6bf9f5d-feed-451b-b797-87de02046e45 req-d5564e93-1c35-47d7-b8a8-584ce36d8197 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:53.450923 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6bf9f5d-feed-451b-b797-87de02046e45 req-d5564e93-1c35-47d7-b8a8-584ce36d8197 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0494695 Aug 24 03:06:53.489224 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c6bf9f5d-feed-451b-b797-87de02046e45 req-1e3a05c1-bc69-4101-b940-5832fb3222bc tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0319879 Aug 24 03:06:53.968324 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c0864594-cc7a-42c0-8bd1-8499466a9575 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:54.384620 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:54.608961 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd46c04-713f-4ffb-81b5-2a5dcd04b784 req-42556ff8-8455-4d72-a170-b93d1d42b4a2 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:54.610615 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3cd46c04-713f-4ffb-81b5-2a5dcd04b784 req-42556ff8-8455-4d72-a170-b93d1d42b4a2 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0534775 Aug 24 03:06:54.651506 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3cd46c04-713f-4ffb-81b5-2a5dcd04b784 req-baa7f5e5-a979-4198-a1e3-3cabd031c2fe tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0325456 Aug 24 03:06:54.657745 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 39996) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:54.766894 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3057dd30-713d-438c-bf68-a771cbb04cc3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:54.857269 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3057dd30-713d-438c-bf68-a771cbb04cc3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:54.955637 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3057dd30-713d-438c-bf68-a771cbb04cc3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:54.994196 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3057dd30-713d-438c-bf68-a771cbb04cc3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=749c76a8-8b4c-468d-a7a1-6c994f39fe0a,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:54.998684 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-3057dd30-713d-438c-bf68-a771cbb04cc3 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=84bad2c0e45048c0b3ade325138e892b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3397951 Aug 24 03:06:55.001844 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40000) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:55.052982 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e56e36f3-1532-41f9-8b31-aed6e6bebe0b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:55.081289 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e56e36f3-1532-41f9-8b31-aed6e6bebe0b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:55.231012 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e56e36f3-1532-41f9-8b31-aed6e6bebe0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:55.234176 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e56e36f3-1532-41f9-8b31-aed6e6bebe0b admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:55.235552 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-e56e36f3-1532-41f9-8b31-aed6e6bebe0b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/749c76a8-8b4c-468d-a7a1-6c994f39fe0a HTTP/1.1" status: 204 len: 168 time: 0.2334523 Aug 24 03:06:55.248111 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e56e36f3-1532-41f9-8b31-aed6e6bebe0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=749c76a8-8b4c-468d-a7a1-6c994f39fe0a,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:55.567905 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:55.776827 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1f21e6f-7253-45a7-a94d-084283573859 req-b2207985-dc53-46a9-a595-011ae9dacb06 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:55.778713 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b1f21e6f-7253-45a7-a94d-084283573859 req-b2207985-dc53-46a9-a595-011ae9dacb06 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0563452 Aug 24 03:06:55.818754 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b1f21e6f-7253-45a7-a94d-084283573859 req-9374f2bc-d7ff-4168-8d2e-911bf4876b93 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0339093 Aug 24 03:06:55.900905 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40010) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:55.914966 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ff5641f1-9cd2-48d6-990d-e553425e08e6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:56.003964 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ff5641f1-9cd2-48d6-990d-e553425e08e6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:56.087890 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ff5641f1-9cd2-48d6-990d-e553425e08e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:56.129181 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-ff5641f1-9cd2-48d6-990d-e553425e08e6 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=bcf4ea4a179b4c41bb8f717bfc651ec5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2249422 Aug 24 03:06:56.129181 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff5641f1-9cd2-48d6-990d-e553425e08e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b050373-9d44-42ec-a538-99ad788fcb4b,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:56.129561 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40014) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:06:56.179321 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a635ad6a-e82d-4d6c-8231-61f57b694bca admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:56.205274 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a635ad6a-e82d-4d6c-8231-61f57b694bca admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:56.345046 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a635ad6a-e82d-4d6c-8231-61f57b694bca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:56.347610 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a635ad6a-e82d-4d6c-8231-61f57b694bca admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:56.350806 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a635ad6a-e82d-4d6c-8231-61f57b694bca admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/1b050373-9d44-42ec-a538-99ad788fcb4b HTTP/1.1" status: 204 len: 168 time: 0.2181675 Aug 24 03:06:56.356849 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a635ad6a-e82d-4d6c-8231-61f57b694bca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b050373-9d44-42ec-a538-99ad788fcb4b,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:06:56.943588 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e04517e1-1918-4453-96b8-4680a2479342 req-a0e25547-78e0-41ce-8974-9aff67004134 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:56.945346 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e04517e1-1918-4453-96b8-4680a2479342 req-a0e25547-78e0-41ce-8974-9aff67004134 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0521064 Aug 24 03:06:56.983577 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e04517e1-1918-4453-96b8-4680a2479342 req-b9506ddb-8d94-443e-8a03-ae5ada0971d6 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310340 Aug 24 03:06:57.019852 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:06:58.103207 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6890ab3-589c-4063-a54c-9f771e576785 req-90454056-61a6-46fd-b1c3-3fe7a019b82f tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:58.104741 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a6890ab3-589c-4063-a54c-9f771e576785 req-90454056-61a6-46fd-b1c3-3fe7a019b82f tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0525124 Aug 24 03:06:58.156690 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a6890ab3-589c-4063-a54c-9f771e576785 req-926b2e8e-968e-4561-b243-9be35812364d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431743 Aug 24 03:06:59.278454 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbeaae9c-a904-40aa-b36d-277e9d4f71dc req-064ba99c-80ca-4939-a5dc-d0997eae93a4 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:06:59.280985 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-bbeaae9c-a904-40aa-b36d-277e9d4f71dc req-064ba99c-80ca-4939-a5dc-d0997eae93a4 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0567553 Aug 24 03:06:59.320033 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-bbeaae9c-a904-40aa-b36d-277e9d4f71dc req-3055d10a-104e-4146-8dbd-eec1f90d85a3 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0321257 Aug 24 03:07:00.316881 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 8069cbc1-7d07-44d4-b500-7a5a4c751d09 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:07:00.414988 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 8069cbc1-7d07-44d4-b500-7a5a4c751d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:07:00.426340 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'port_id': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'mac_address': 'fa:16:3e:fe:82:f7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 375, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:07:00.440166 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7abce7-5e9e-4b77-98ea-b76fc19bfa7f req-5aa1df48-92aa-4189-943e-16eae07257e3 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:00.441944 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9c7abce7-5e9e-4b77-98ea-b76fc19bfa7f req-5aa1df48-92aa-4189-943e-16eae07257e3 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 943 time: 0.0537686 Aug 24 03:07:00.465797 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:00.479600 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8069cbc1-7d07-44d4-b500-7a5a4c751d09 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:07:00.481815 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9c7abce7-5e9e-4b77-98ea-b76fc19bfa7f req-86f81fe1-a0ee-44e6-a0ea-dc5efe77b412 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0335157 Aug 24 03:07:00.499491 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 8069cbc1-7d07-44d4-b500-7a5a4c751d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:07:00.568052 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:00.615894 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=8069cbc1-7d07-44d4-b500-7a5a4c751d09,revision_number=7']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:00.623707 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:00.624157 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:00.624510 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:00.624850 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:00.625187 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:00.625522 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:00.625879 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:00.626210 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:00.626610 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:00.626992 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:00.627343 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:00.627690 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:00.836347 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['8069cbc1-7d07-44d4-b500-7a5a4c751d09'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:07:01.600278 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d87a3b91-57ab-4bfa-aebc-c5488723af57 req-cd3bd9f5-0b36-4aac-a3aa-df5972b477e2 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:01.601774 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d87a3b91-57ab-4bfa-aebc-c5488723af57 req-cd3bd9f5-0b36-4aac-a3aa-df5972b477e2 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 944 time: 0.0523114 Aug 24 03:07:01.641529 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d87a3b91-57ab-4bfa-aebc-c5488723af57 req-b451e7c9-0f6b-43d9-aea7-28e40f642be4 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0326028 Aug 24 03:07:02.664381 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 8069cbc1-7d07-44d4-b500-7a5a4c751d09 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:07:02.714580 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:07:02.714949 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:02.756216 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08d56bff-944c-4da8-9bba-e0301c765da1 req-ef329284-8c86-4691-8a15-482b0dc8d8bd tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:02.757710 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-08d56bff-944c-4da8-9bba-e0301c765da1 req-ef329284-8c86-4691-8a15-482b0dc8d8bd tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 944 time: 0.0477810 Aug 24 03:07:02.793916 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:02.795464 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-08d56bff-944c-4da8-9bba-e0301c765da1 req-0c821eb8-d487-4b91-b42e-15664805f66b tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0316982 Aug 24 03:07:02.816824 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:07:02.819082 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ac0ca16f-296a-4572-b0ac-04a77dc8f38e" -d '{"events": [{"server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "name": "network-vif-plugged", "status": "completed", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:07:02.832642 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 8069cbc1-7d07-44d4-b500-7a5a4c751d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:07:02.855277 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:07:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3aa9ab8-0ea4-4eb6-804b-a5deedc8af9a x-openstack-request-id: req-f3aa9ab8-0ea4-4eb6-804b-a5deedc8af9a {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:07:02.855435 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "name": "network-vif-plugged", "status": "completed", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:07:02.855651 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f3aa9ab8-0ea4-4eb6-804b-a5deedc8af9a {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:07:02.856036 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'code': 200} Aug 24 03:07:02.915641 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:02.966826 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=8069cbc1-7d07-44d4-b500-7a5a4c751d09,revision_number=8']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:03.907458 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f66e584-fad3-4fce-b934-4646f20b3be8 req-6363b765-ad99-49f4-bc8b-f01307215049 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:03.908933 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2f66e584-fad3-4fce-b934-4646f20b3be8 req-6363b765-ad99-49f4-bc8b-f01307215049 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0471799 Aug 24 03:07:03.949072 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2f66e584-fad3-4fce-b934-4646f20b3be8 req-a7160005-754d-453d-aa6e-36364226d90e tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0342875 Aug 24 03:07:04.817739 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9d3adb-67aa-4d4e-8c06-f7954e71cac0 req-313b414a-f55d-4d7b-8164-b7a41c33677e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:04.819084 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5b9d3adb-67aa-4d4e-8c06-f7954e71cac0 req-313b414a-f55d-4d7b-8164-b7a41c33677e service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 1098 time: 0.0398600 Aug 24 03:07:04.853988 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5b9d3adb-67aa-4d4e-8c06-f7954e71cac0 req-0fa00470-4acb-441f-aecb-f6dec5fb0144 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0274043 Aug 24 03:07:05.064370 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c69f3601-4714-4a81-97fa-15d9aa418050 req-1333c222-0049-4c13-8d9b-68597fdf9a11 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:05.065938 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c69f3601-4714-4a81-97fa-15d9aa418050 req-1333c222-0049-4c13-8d9b-68597fdf9a11 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0492303 Aug 24 03:07:05.106308 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c69f3601-4714-4a81-97fa-15d9aa418050 req-ea948dee-6a02-47ea-b046-59614c20ef13 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0340998 Aug 24 03:07:06.221724 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b8d4bd-3290-498f-81fd-6bc0595b92dc req-06d29e47-91b0-465b-b587-2456c6861abf tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:06.223264 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c7b8d4bd-3290-498f-81fd-6bc0595b92dc req-06d29e47-91b0-465b-b587-2456c6861abf tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0510230 Aug 24 03:07:06.262272 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c7b8d4bd-3290-498f-81fd-6bc0595b92dc req-c6a7bef7-a933-46b5-9240-ae962625e271 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0330830 Aug 24 03:07:06.567827 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:07:08.624545 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:09.197115 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40170) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:09.300442 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e1af49bc-e273-4b52-aa4b-2c39034bca1b admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:09.385470 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e1af49bc-e273-4b52-aa4b-2c39034bca1b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:09.499451 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e1af49bc-e273-4b52-aa4b-2c39034bca1b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:09.535927 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-e1af49bc-e273-4b52-aa4b-2c39034bca1b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=5f4fa73370f743a09a0044da11bbb3d1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3376417 Aug 24 03:07:09.537043 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1af49bc-e273-4b52-aa4b-2c39034bca1b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19a128a0-a00c-44c6-bb4e-1cdb2a79fd03,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:09.538546 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40174) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:09.586397 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-778fa52f-c5d1-4f80-8ec8-58092bf14a8f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:09.606739 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-778fa52f-c5d1-4f80-8ec8-58092bf14a8f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:09.715976 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-778fa52f-c5d1-4f80-8ec8-58092bf14a8f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:09.719165 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-778fa52f-c5d1-4f80-8ec8-58092bf14a8f admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:09.720338 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-778fa52f-c5d1-4f80-8ec8-58092bf14a8f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/19a128a0-a00c-44c6-bb4e-1cdb2a79fd03 HTTP/1.1" status: 204 len: 168 time: 0.1807849 Aug 24 03:07:09.728004 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-778fa52f-c5d1-4f80-8ec8-58092bf14a8f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19a128a0-a00c-44c6-bb4e-1cdb2a79fd03,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:10.431706 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40186) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:10.445995 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-15978a53-abfb-4bec-b439-03e679fce302 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:10.531142 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-15978a53-abfb-4bec-b439-03e679fce302 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:10.607034 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-15978a53-abfb-4bec-b439-03e679fce302 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:10.643827 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15978a53-abfb-4bec-b439-03e679fce302 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f36f8e5-cc9c-4ad2-a8ac-8b36e410c7a0,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:10.648123 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-15978a53-abfb-4bec-b439-03e679fce302 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=94558a18d6e34effb43e5fe7f03ad0fc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2154202 Aug 24 03:07:10.651119 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40188) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:10.697986 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-250240bd-7bc6-433a-a345-8ddad7e87a46 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:10.719420 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-250240bd-7bc6-433a-a345-8ddad7e87a46 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:10.830356 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-250240bd-7bc6-433a-a345-8ddad7e87a46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:10.832889 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-250240bd-7bc6-433a-a345-8ddad7e87a46 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:10.834086 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-250240bd-7bc6-433a-a345-8ddad7e87a46 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2f36f8e5-cc9c-4ad2-a8ac-8b36e410c7a0 HTTP/1.1" status: 204 len: 168 time: 0.1824057 Aug 24 03:07:10.843937 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-250240bd-7bc6-433a-a345-8ddad7e87a46 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f36f8e5-cc9c-4ad2-a8ac-8b36e410c7a0,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:13.662037 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40262) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:13.767508 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fc41908f-46c1-40ed-a347-f2eea65edb57 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:13.857817 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fc41908f-46c1-40ed-a347-f2eea65edb57 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:14.011939 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-fc41908f-46c1-40ed-a347-f2eea65edb57 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:14.050180 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-fc41908f-46c1-40ed-a347-f2eea65edb57 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=7c90b06a49a24d7dada651ed97a9744a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3869061 Aug 24 03:07:14.051370 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc41908f-46c1-40ed-a347-f2eea65edb57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22bbbd73-caea-4455-a642-6cea5a12eb1d,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:14.052857 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40266) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:14.104028 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e3c3dd22-768d-4f39-844c-a66272dce2d2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:14.123958 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e3c3dd22-768d-4f39-844c-a66272dce2d2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:14.240905 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e3c3dd22-768d-4f39-844c-a66272dce2d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:14.243521 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e3c3dd22-768d-4f39-844c-a66272dce2d2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:14.244671 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-e3c3dd22-768d-4f39-844c-a66272dce2d2 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/22bbbd73-caea-4455-a642-6cea5a12eb1d HTTP/1.1" status: 204 len: 168 time: 0.1908259 Aug 24 03:07:14.253153 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c3dd22-768d-4f39-844c-a66272dce2d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22bbbd73-caea-4455-a642-6cea5a12eb1d,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:14.881844 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40274) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:14.894899 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-266375ff-4b9c-49de-9639-91a94f3be441 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:14.980721 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-266375ff-4b9c-49de-9639-91a94f3be441 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:15.058385 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-266375ff-4b9c-49de-9639-91a94f3be441 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:15.095254 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-266375ff-4b9c-49de-9639-91a94f3be441 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=745870b3-688a-4bdb-8bc0-b4fc402bbaf4,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:15.101251 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-266375ff-4b9c-49de-9639-91a94f3be441 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=41aee526fcbe4279b15365b27ef42636&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2183280 Aug 24 03:07:15.103934 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40278) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:15.152278 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d2209ee0-2cf8-4d83-a415-d63139353b36 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:15.175926 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d2209ee0-2cf8-4d83-a415-d63139353b36 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:15.292642 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d2209ee0-2cf8-4d83-a415-d63139353b36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:15.295232 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d2209ee0-2cf8-4d83-a415-d63139353b36 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:15.297453 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-d2209ee0-2cf8-4d83-a415-d63139353b36 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/745870b3-688a-4bdb-8bc0-b4fc402bbaf4 HTTP/1.1" status: 204 len: 168 time: 0.1925848 Aug 24 03:07:15.305946 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2209ee0-2cf8-4d83-a415-d63139353b36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=745870b3-688a-4bdb-8bc0-b4fc402bbaf4,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:17.343125 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57e197cc-6e0e-4633-ac8c-991357692540 req-fcf6c746-8a3c-419f-88b9-164b6e0718ba tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:17.344593 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-57e197cc-6e0e-4633-ac8c-991357692540 req-fcf6c746-8a3c-419f-88b9-164b6e0718ba tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 947 time: 0.0489531 Aug 24 03:07:17.387190 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-57e197cc-6e0e-4633-ac8c-991357692540 req-74fd99b1-66b5-4d84-ba77-d28b6b6dde2d tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0365217 Aug 24 03:07:18.511861 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7346c90-b157-4904-b088-9d5723a11f4c req-00537f19-d183-4f80-9c84-f65c53d026a8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:18.513324 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a7346c90-b157-4904-b088-9d5723a11f4c req-00537f19-d183-4f80-9c84-f65c53d026a8 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 947 time: 0.0520146 Aug 24 03:07:18.552753 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a7346c90-b157-4904-b088-9d5723a11f4c req-b713aa47-2fe7-4ab2-b75d-70eb25015fac tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups?id=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0326335 Aug 24 03:07:18.685498 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-8c0db643-e9ac-4936-a868-311efbc8a405 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:18.687774 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-8c0db643-e9ac-4936-a868-311efbc8a405 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.43 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 947 time: 0.0484929 Aug 24 03:07:18.783858 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Deleting port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:07:18.784199 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:18.870239 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] For port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:07:18.870599 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:19.051069 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:19.051465 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:19.051786 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.l3_db [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Floating IP b37e0710-3186-4170-9811-0e1e7a33642b disassociated. External IP: 172.27.2.171, port: 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09. Aug 24 03:07:19.052128 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Calling delete_port for 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:07:19.287624 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:19.318026 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event deleted for resources: {'Port': ['ID=11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:19.327487 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:19.327878 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:19.328962 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:19.329317 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:19.329676 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:19.330020 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:19.330352 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:19.330682 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:19.331495 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:19.331495 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:19.331754 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:19.331948 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:19.443084 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Router 0195ba54-f802-48e9-b0df-bdb173e4aa57 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:07:19.545636 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:07:19.555928 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96b449c8-13c9-4207-b7c9-783f290df111 None None] Sync routers for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:07:19.565781 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96b449c8-13c9-4207-b7c9-783f290df111 None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:07:19.566553 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-96b449c8-13c9-4207-b7c9-783f290df111 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:06:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:07:19.588047 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] No DVR routers for this DVR port 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:07:19.590759 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:19.593229 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0ec1058d-e59d-4d34-8f97-9b123f11c736 req-5f7eee5a-391b-4778-ae87-e591f0d5d17c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.43 "DELETE /v2.0/ports/11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 HTTP/1.1" status: 204 len: 173 time: 0.8999314 Aug 24 03:07:19.594040 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'name': 'network-vif-deleted', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:07:19.596827 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5683462d-2e7b-42ec-9707-d1ce953be53c" -d '{"events": [{"server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "name": "network-vif-deleted", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:07:19.635889 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:07:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11084e48-1ffd-4ea3-bb4b-41fbc5379b5b x-openstack-request-id: req-11084e48-1ffd-4ea3-bb4b-41fbc5379b5b {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:07:19.638732 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "33482882-ec75-42b7-b021-3ffa7e1e7161", "name": "network-vif-deleted", "tag": "11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:07:19.638732 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-11084e48-1ffd-4ea3-bb4b-41fbc5379b5b {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:07:19.638732 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '33482882-ec75-42b7-b021-3ffa7e1e7161', 'name': 'network-vif-deleted', 'tag': '11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09', 'status': 'completed', 'code': 200} Aug 24 03:07:19.682194 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e3116075-3063-4e5a-9bfe-6b659de4d2ab req-74611534-dba8-443a-b0d1-da4050ab476b tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/ports?device_id=33482882-ec75-42b7-b021-3ffa7e1e7161 HTTP/1.1" status: 200 len: 210 time: 0.0325480 Aug 24 03:07:19.693446 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-96b449c8-13c9-4207-b7c9-783f290df111 None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:07:19.892542 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-96b449c8-13c9-4207-b7c9-783f290df111 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:49Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:07:19.922907 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96b449c8-13c9-4207-b7c9-783f290df111 None None] Checking router: 0195ba54-f802-48e9-b0df-bdb173e4aa57 for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:07:19.931521 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96b449c8-13c9-4207-b7c9-783f290df111 None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:07:19.932175 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-96b449c8-13c9-4207-b7c9-783f290df111 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:06:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:07:20.035194 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-96b449c8-13c9-4207-b7c9-783f290df111 None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:07:20.322160 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-96b449c8-13c9-4207-b7c9-783f290df111 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:49Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:07:20.348206 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96b449c8-13c9-4207-b7c9-783f290df111 None None] The sync data for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi is: [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:00:43Z', 'revision_number': 4, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '6782d692-12a1-4a0e-a724-1f35a1861898', 'name': '', 'network_id': '72400947-ffa3-49a8-8805-03fdb89d0cfb', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'mac_address': 'fa:16:3e:5f:6b:0f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_interface', 'standard_attr_id': 245, 'fixed_ips': [{'subnet_id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:43Z', 'updated_at': '2021-08-24T03:00:49Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'subnets': [{'id': '465e9b83-ccde-4ea3-8e80-86590891b03c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:07:20.577422 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-701597d2-0846-42e0-8777-9aa8b8e23a0d None None] New status for floating IP b37e0710-3186-4170-9811-0e1e7a33642b: DOWN {{(pid=111277) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:07:21.441351 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c8e9ec9b-b15f-4ba5-8c9c-1d3c95f14912 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:21.894243 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40388) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:21.954212 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cfbfa8f5-9cac-4350-8ec0-f70dab811e7c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:21.980797 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cfbfa8f5-9cac-4350-8ec0-f70dab811e7c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:22.116003 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cfbfa8f5-9cac-4350-8ec0-f70dab811e7c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:22.118453 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-cfbfa8f5-9cac-4350-8ec0-f70dab811e7c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:22.119709 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-cfbfa8f5-9cac-4350-8ec0-f70dab811e7c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "DELETE /v2.0/security-groups/12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d HTTP/1.1" status: 204 len: 168 time: 0.2244668 Aug 24 03:07:22.122455 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40392) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:22.129357 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfbfa8f5-9cac-4350-8ec0-f70dab811e7c tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:22.136554 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.api.v2.resource [None req-c25455a4-4cb4-4b42-a463-0db1e89d1843 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] show failed (client error): The resource could not be found. Aug 24 03:07:22.137552 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-c25455a4-4cb4-4b42-a463-0db1e89d1843 tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "GET /v2.0/security-groups/12a6d04c-53a8-484e-a3f9-1e1bd2de2b4d HTTP/1.1" status: 404 len: 347 time: 0.0140967 Aug 24 03:07:22.146808 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40394) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:22.268517 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-7cd93a04-057a-42cb-b357-2823626ea37a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Deleting port 5cd27a18-25a8-4724-8f22-a21e62260ab5 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:07:22.268850 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7cd93a04-057a-42cb-b357-2823626ea37a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:22.343071 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7cd93a04-057a-42cb-b357-2823626ea37a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:22.343910 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7cd93a04-057a-42cb-b357-2823626ea37a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:22.355037 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-7cd93a04-057a-42cb-b357-2823626ea37a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Calling delete_port for 5cd27a18-25a8-4724-8f22-a21e62260ab5 owned by network:floatingip {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:07:22.424507 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:07:22.446876 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:07:22.447219 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 11ea6b00-f6a9-4c5e-bbbd-b3ea8a2b0d09 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:07:22.573096 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7cd93a04-057a-42cb-b357-2823626ea37a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:22.599615 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cd93a04-057a-42cb-b357-2823626ea37a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Pushing event deleted for resources: {'Port': ['ID=5cd27a18-25a8-4724-8f22-a21e62260ab5,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:22.677123 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7cd93a04-057a-42cb-b357-2823626ea37a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks [] for floatingip, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:22.680352 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-7cd93a04-057a-42cb-b357-2823626ea37a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:22.681868 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-7cd93a04-057a-42cb-b357-2823626ea37a tempest-AttachVolumeShelveTestJSON-764064317 tempest-AttachVolumeShelveTestJSON-764064317-project] 10.222.0.30 "DELETE /v2.0/floatingips/b37e0710-3186-4170-9811-0e1e7a33642b HTTP/1.1" status: 204 len: 168 time: 0.5340595 Aug 24 03:07:23.496239 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40412) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:23.603487 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2a9c3cf9-8fbd-4d5d-9843-b3d8e2637f2a admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:23.691830 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2a9c3cf9-8fbd-4d5d-9843-b3d8e2637f2a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:23.755707 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2a9c3cf9-8fbd-4d5d-9843-b3d8e2637f2a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:23.794157 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-2a9c3cf9-8fbd-4d5d-9843-b3d8e2637f2a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=16287027b683450c9eeda366800f4608&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2968688 Aug 24 03:07:23.795132 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a9c3cf9-8fbd-4d5d-9843-b3d8e2637f2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f02cda6-d7cd-4de2-a1f6-31ac18d84d94,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:23.796925 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40418) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:23.845904 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0691b107-b814-4eac-9e63-98a51da65f8f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:23.866051 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0691b107-b814-4eac-9e63-98a51da65f8f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:24.013479 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0691b107-b814-4eac-9e63-98a51da65f8f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:24.013723 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-c33c36e2-ff53-4806-b4e5-227fcc6074ab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:24.016901 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0691b107-b814-4eac-9e63-98a51da65f8f admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:24.018120 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-0691b107-b814-4eac-9e63-98a51da65f8f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/0f02cda6-d7cd-4de2-a1f6-31ac18d84d94 HTTP/1.1" status: 204 len: 168 time: 0.2201972 Aug 24 03:07:24.026894 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0691b107-b814-4eac-9e63-98a51da65f8f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f02cda6-d7cd-4de2-a1f6-31ac18d84d94,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:24.447508 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:25.572840 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:25.746290 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40446) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:26.478409 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2d958bf5-b224-45d0-bd18-5f0067b93166 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-566649'] for router_interface, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:26.716683 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-2d958bf5-b224-45d0-bd18-5f0067b93166 admin admin] Deleting port 6782d692-12a1-4a0e-a724-1f35a1861898 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:07:26.717018 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2d958bf5-b224-45d0-bd18-5f0067b93166 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:26.792493 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-2d958bf5-b224-45d0-bd18-5f0067b93166 admin admin] For port 6782d692-12a1-4a0e-a724-1f35a1861898, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=6782d692-12a1-4a0e-a724-1f35a1861898,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:07:26.793150 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2d958bf5-b224-45d0-bd18-5f0067b93166 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:26.805931 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-2d958bf5-b224-45d0-bd18-5f0067b93166 admin admin] Calling delete_port for 6782d692-12a1-4a0e-a724-1f35a1861898 owned by network:router_interface {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:07:26.995670 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:27.035917 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2d958bf5-b224-45d0-bd18-5f0067b93166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:27.068064 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d958bf5-b224-45d0-bd18-5f0067b93166 admin admin] Pushing event deleted for resources: {'Port': ['ID=6782d692-12a1-4a0e-a724-1f35a1861898,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:27.231405 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2d958bf5-b224-45d0-bd18-5f0067b93166 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-748285', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-566109'] for router_interface, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:27.441866 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2d958bf5-b224-45d0-bd18-5f0067b93166 admin admin] Router 0195ba54-f802-48e9-b0df-bdb173e4aa57 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:07:27.543045 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d958bf5-b224-45d0-bd18-5f0067b93166 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:07:27.547956 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-2d958bf5-b224-45d0-bd18-5f0067b93166 admin admin] 10.222.0.30 "PUT /v2.0/routers/0195ba54-f802-48e9-b0df-bdb173e4aa57/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8006549 Aug 24 03:07:27.551481 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40456) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:27.552013 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-930dbfd5-5abf-4ff8-9dc7-bdd150333566 None None] Sync routers for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:07:27.565188 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-930dbfd5-5abf-4ff8-9dc7-bdd150333566 None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:07:27.565828 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-930dbfd5-5abf-4ff8-9dc7-bdd150333566 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:07:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:07:27.653637 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Notify callbacks [] for router, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:27.667871 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-930dbfd5-5abf-4ff8-9dc7-bdd150333566 None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:07:27.753857 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:27.838381 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-930dbfd5-5abf-4ff8-9dc7-bdd150333566 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91'}], 'enable_snat': True}, 'gw_port_id': '10411837-b2f0-4732-b5be-89d265552b35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:07:26Z', 'revision_number': 5, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port': {'id': '10411837-b2f0-4732-b5be-89d265552b35', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:6c:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'device_owner': 'network:router_gateway', 'standard_attr_id': 244, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.91', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:00:40Z', 'updated_at': '2021-08-24T03:00:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:07:27.864202 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-930dbfd5-5abf-4ff8-9dc7-bdd150333566 None None] Checking router: 0195ba54-f802-48e9-b0df-bdb173e4aa57 for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:07:27.872351 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-930dbfd5-5abf-4ff8-9dc7-bdd150333566 None None] Routers {'0195ba54-f802-48e9-b0df-bdb173e4aa57'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:07:27.872977 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-930dbfd5-5abf-4ff8-9dc7-bdd150333566 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:07:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['0195ba54-f802-48e9-b0df-bdb173e4aa57'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:07:27.901827 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Deleting port 10411837-b2f0-4732-b5be-89d265552b35 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:07:27.902418 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:27.956257 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-930dbfd5-5abf-4ff8-9dc7-bdd150333566 None None] Set router 0195ba54-f802-48e9-b0df-bdb173e4aa57 gateway port host: None {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:07:27.978826 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] For port 10411837-b2f0-4732-b5be-89d265552b35, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=10411837-b2f0-4732-b5be-89d265552b35,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:07:27.979278 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:27.991301 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Calling delete_port for 10411837-b2f0-4732-b5be-89d265552b35 owned by network:router_gateway {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:07:28.009164 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-930dbfd5-5abf-4ff8-9dc7-bdd150333566 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:07:27Z', 'revision_number': 6, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port_host': None}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:07:28.036396 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-930dbfd5-5abf-4ff8-9dc7-bdd150333566 None None] The sync data for ids ['0195ba54-f802-48e9-b0df-bdb173e4aa57'] in dv-cinder-803748-8-iscsi is: [{'id': '0195ba54-f802-48e9-b0df-bdb173e4aa57', 'name': 'tempest-AttachVolumeShelveTestJSON-1119859146-router', 'tenant_id': '6b319ec439ef48f18d76e47df6300bc6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:00:39Z', 'updated_at': '2021-08-24T03:07:27Z', 'revision_number': 6, 'project_id': '6b319ec439ef48f18d76e47df6300bc6', 'gw_port_host': None}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:07:28.281730 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:28.311703 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Pushing event deleted for resources: {'Port': ['ID=10411837-b2f0-4732-b5be-89d265552b35,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:28.373643 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-569567'] for router_gateway, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:28.465181 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-560207', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32699'] for router, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:28.467274 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:28.566313 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557756'] for router, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:28.566767 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0195ba54-f802-48e9-b0df-bdb173e4aa57 {{(pid=111275) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Aug 24 03:07:28.572776 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] Notify callbacks [] for router, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:28.572776 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a7aa96ba-544d-4056-91e6-ad0d1251979e admin admin] 10.222.0.30 "DELETE /v2.0/routers/0195ba54-f802-48e9-b0df-bdb173e4aa57 HTTP/1.1" status: 204 len: 168 time: 1.0198305 Aug 24 03:07:28.574839 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40460) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:28.622837 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-381815ee-98ab-4528-9ba8-759c40593ea6 admin admin] Deleting subnet 465e9b83-ccde-4ea3-8e80-86590891b03c {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:07:28.625899 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-381815ee-98ab-4528-9ba8-759c40593ea6 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:28.663491 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-381815ee-98ab-4528-9ba8-759c40593ea6 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:28.740781 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-381815ee-98ab-4528-9ba8-759c40593ea6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:28.836851 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-381815ee-98ab-4528-9ba8-759c40593ea6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:28.865248 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-381815ee-98ab-4528-9ba8-759c40593ea6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=465e9b83-ccde-4ea3-8e80-86590891b03c,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:28.870815 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-381815ee-98ab-4528-9ba8-759c40593ea6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:28.872685 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-381815ee-98ab-4528-9ba8-759c40593ea6 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/465e9b83-ccde-4ea3-8e80-86590891b03c HTTP/1.1" status: 204 len: 168 time: 0.2969387 Aug 24 03:07:28.875706 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40462) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:28.877281 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6759a104-cdae-414c-97b0-e979ae004f80 None None] Network 72400947-ffa3-49a8-8805-03fdb89d0cfb requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:07:28.955534 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.019070 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Deleting port d69eed58-c0db-4143-a55f-670858fac28b {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:07:29.019407 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.074827 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-544fd8fe-5cbe-4125-b642-0c7f4f924657 None None] DHCP port deletion for 72400947-ffa3-49a8-8805-03fdb89d0cfb request from dv-cinder-803748-8-iscsi {{(pid=111277) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Aug 24 03:07:29.088479 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] For port d69eed58-c0db-4143-a55f-670858fac28b, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=d69eed58-c0db-4143-a55f-670858fac28b,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:07:29.088952 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.113130 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Calling delete_port for d69eed58-c0db-4143-a55f-670858fac28b owned by network:dhcp {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:07:29.127824 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-544fd8fe-5cbe-4125-b642-0c7f4f924657 None None] Deleting port d69eed58-c0db-4143-a55f-670858fac28b {{(pid=111277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:07:29.128207 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-544fd8fe-5cbe-4125-b642-0c7f4f924657 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.172419 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 10411837-b2f0-4732-b5be-89d265552b35 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:07:29.194848 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: 10411837-b2f0-4732-b5be-89d265552b35 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:07:29.195276 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 10411837-b2f0-4732-b5be-89d265552b35 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:07:29.195605 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 6782d692-12a1-4a0e-a724-1f35a1861898 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:07:29.222259 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: 6782d692-12a1-4a0e-a724-1f35a1861898 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:07:29.222635 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 6782d692-12a1-4a0e-a724-1f35a1861898 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:07:29.223040 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device d69eed58-c0db-4143-a55f-670858fac28b no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:07:29.261396 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-544fd8fe-5cbe-4125-b642-0c7f4f924657 None None] For port d69eed58-c0db-4143-a55f-670858fac28b, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=d69eed58-c0db-4143-a55f-670858fac28b,segment=NetworkSegment(f890483e-ac55-4cdc-9004-ef9743d5959e),segment_id=f890483e-ac55-4cdc-9004-ef9743d5959e)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:07:29.261752 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-544fd8fe-5cbe-4125-b642-0c7f4f924657 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.269880 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.280238 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-544fd8fe-5cbe-4125-b642-0c7f4f924657 None None] Calling delete_port for d69eed58-c0db-4143-a55f-670858fac28b owned by network:dhcp {{(pid=111277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:07:29.292671 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No active binding found for port d69eed58-c0db-4143-a55f-670858fac28b {{(pid=111277) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Aug 24 03:07:29.299020 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device d69eed58-c0db-4143-a55f-670858fac28b not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:07:29.299390 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Pushing event deleted for resources: {'Port': ['ID=d69eed58-c0db-4143-a55f-670858fac28b,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:29.302645 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] No DVR routers for this DVR port d69eed58-c0db-4143-a55f-670858fac28b on host dv-cinder-803748-8-iscsi {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:07:29.363997 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-544fd8fe-5cbe-4125-b642-0c7f4f924657 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054'] for port, after_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.389504 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-544fd8fe-5cbe-4125-b642-0c7f4f924657 None None] Pushing event deleted for resources: {'Port': ['ID=d69eed58-c0db-4143-a55f-670858fac28b,revision_number=None']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:29.394036 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-544fd8fe-5cbe-4125-b642-0c7f4f924657 None None] No DVR routers for this DVR port d69eed58-c0db-4143-a55f-670858fac28b on host dv-cinder-803748-8-iscsi {{(pid=111277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:07:29.628373 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.638091 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['72400947-ffa3-49a8-8805-03fdb89d0cfb']}} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:07:29.649010 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f890483e-ac55-4cdc-9004-ef9743d5959e') {'for_net_delete': True} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:07:29.649311 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f890483e-ac55-4cdc-9004-ef9743d5959e') {} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:07:29.658289 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25761368'] for segment, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.671435 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.678129 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Releasing vlan 356 on physical network physnet1 to pool {{(pid=111276) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:07:29.678512 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3525699'] for segment, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: Traceback (most recent call last): Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: timer() Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: cb(*args, **kw) Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: return func(*args, **kwargs) Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: self._notify() Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: self.callback(batched_events) Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: event.method(event) Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: return f(self, *a, **k) Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._get(url).json() Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: return self.request(url, 'GET', **kwargs) Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:07:29.681609 dv-cinder-803748-8-iscsi neutron-server[111276]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:07:29.788652 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.794435 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:29.796839 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] 10.222.0.30 "DELETE /v2.0/networks/72400947-ffa3-49a8-8805-03fdb89d0cfb HTTP/1.1" status: 204 len: 168 time: 0.9190176 Aug 24 03:07:29.809505 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ee01fd5-a797-45d8-b057-222ad2da257e admin admin] Pushing event deleted for resources: {'Network': ['ID=72400947-ffa3-49a8-8805-03fdb89d0cfb,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:30.138472 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40478) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:30.179652 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-f57e3a1a-87c2-470b-a15b-a17860f8dd25 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6b319ec439ef48f18d76e47df6300bc6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0397298 Aug 24 03:07:30.181937 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40482) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:30.233948 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-56374566-4c7b-47af-96fa-4017da0de310 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:30.255188 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-56374566-4c7b-47af-96fa-4017da0de310 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:30.382889 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-56374566-4c7b-47af-96fa-4017da0de310 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:30.385457 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-56374566-4c7b-47af-96fa-4017da0de310 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:30.386663 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-56374566-4c7b-47af-96fa-4017da0de310 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3e62db95-91cd-4252-b52e-b0890d0be853 HTTP/1.1" status: 204 len: 168 time: 0.2038438 Aug 24 03:07:30.395065 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56374566-4c7b-47af-96fa-4017da0de310 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e62db95-91cd-4252-b52e-b0890d0be853,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:38.618607 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:39.908879 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26a670dd-ca11-4ecb-b65b-efbf65b65d64 req-d37fb4d0-4ffd-49dd-b449-390df9c000f6 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0418656 Aug 24 03:07:39.973409 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a670dd-ca11-4ecb-b65b-efbf65b65d64 req-02da9f45-c566-4fc2-ae3d-65131820eabf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:39.975019 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26a670dd-ca11-4ecb-b65b-efbf65b65d64 req-02da9f45-c566-4fc2-ae3d-65131820eabf service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 1098 time: 0.0433586 Aug 24 03:07:40.084227 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a670dd-ca11-4ecb-b65b-efbf65b65d64 req-eedf0f9f-b12b-4a28-be01-257b6f74f15c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:40.086282 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26a670dd-ca11-4ecb-b65b-efbf65b65d64 req-eedf0f9f-b12b-4a28-be01-257b6f74f15c service neutron] 10.222.0.43 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 913 time: 0.0905631 Aug 24 03:07:40.152965 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26a670dd-ca11-4ecb-b65b-efbf65b65d64 req-fca37803-0b82-4ed2-a740-30a81c4a216d service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a8f7945f-96cc-40aa-897c-b9f7dd88be75 HTTP/1.1" status: 200 len: 1001 time: 0.0587254 Aug 24 03:07:40.208947 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a670dd-ca11-4ecb-b65b-efbf65b65d64 req-b5a35d3c-2156-4a53-9942-715da84a63a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:40.210739 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26a670dd-ca11-4ecb-b65b-efbf65b65d64 req-b5a35d3c-2156-4a53-9942-715da84a63a9 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 200 len: 851 time: 0.0501773 Aug 24 03:07:40.257880 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a670dd-ca11-4ecb-b65b-efbf65b65d64 req-a549d414-ad1b-474e-81d2-be4cee6f950b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:40.259378 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26a670dd-ca11-4ecb-b65b-efbf65b65d64 req-a549d414-ad1b-474e-81d2-be4cee6f950b service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0414569 Aug 24 03:07:40.355625 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26a670dd-ca11-4ecb-b65b-efbf65b65d64 req-0931abbb-941b-47ec-8b8f-268808adf9a7 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825415 Aug 24 03:07:40.457784 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-26a670dd-ca11-4ecb-b65b-efbf65b65d64 req-577a95f6-1df6-4970-8adf-b9137f832c51 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857773 Aug 24 03:07:41.192299 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40680) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:41.299499 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-28f9e25c-c93b-4379-b8f0-d10edd097d9a admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:41.387796 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-28f9e25c-c93b-4379-b8f0-d10edd097d9a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:41.458324 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-28f9e25c-c93b-4379-b8f0-d10edd097d9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:41.499262 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-28f9e25c-c93b-4379-b8f0-d10edd097d9a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=74bdd9029fc64d68a892497d62c9adef&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3058238 Aug 24 03:07:41.500442 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f9e25c-c93b-4379-b8f0-d10edd097d9a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=91fe7d48-b3f0-4a31-ba6d-bb53c58827c6,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:41.502065 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40686) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:41.550762 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:41.572860 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:41.681399 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:41.683990 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:41.685161 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/91fe7d48-b3f0-4a31-ba6d-bb53c58827c6 HTTP/1.1" status: 204 len: 168 time: 0.1820512 Aug 24 03:07:41.692883 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=91fe7d48-b3f0-4a31-ba6d-bb53c58827c6,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:41.699863 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:41.700216 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:41.700563 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:41.700919 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:41.701240 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:41.701566 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:41.706087 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:41.706087 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:41.706087 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:41.706087 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:41.706087 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:41.706087 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629ce31c-197f-4b20-8ef7-77ba4bf535d0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:07:43.567060 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:07:51.383712 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-89f68171-f309-4fa3-a913-91b6580f20e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:53.592291 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-1c302dab-8360-497f-99f2-72cf3edcfb9f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1453650260&fields=id&tenant_id=03198f839b864099b1c011c0fc54c7dd HTTP/1.1" status: 200 len: 267 time: 0.0320859 Aug 24 03:07:53.699547 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b53eda3e-f564-40bf-b701-4bb677615056 req-ddd17f39-fbd5-4d2b-ac8f-3e81cf5b5c49 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:53.701016 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-ddd17f39-fbd5-4d2b-ac8f-3e81cf5b5c49 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 812 time: 0.1023612 Aug 24 03:07:53.716202 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-445faf04-65a3-49a7-a3b0-9bcbe717e9d3 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/quotas/03198f839b864099b1c011c0fc54c7dd HTTP/1.1" status: 200 len: 375 time: 0.0094371 Aug 24 03:07:53.773828 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-3147c05d-a9c6-4611-9c69-5d5d794f701e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0521560 Aug 24 03:07:53.963311 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-f8fa74ea-62fe-4ec1-96f9-989dff6f6bca service neutron] 10.222.0.30 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1784465 Aug 24 03:07:53.994521 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-bf0cf55f-0a51-4cff-865f-ce844b45dcf1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:54.059153 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-c57c8aef-f335-4de3-97e6-2c29c3641e6d service neutron] 10.222.0.30 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831530 Aug 24 03:07:54.365272 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:54.698099 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-67d94102-b87c-4cd3-92c0-be6b8c3c5b75 req-1814338a-cbd6-46b6-9b17-9d5c449b9b08 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 210 time: 0.0272079 Aug 24 03:07:55.620678 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:55.690810 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40900) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:55.792886 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d38235c1-6425-4d8b-990d-0f7f6a5feedc req-7e300aa9-b749-46e0-bf86-59e9cfdb398e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 210 time: 0.0280373 Aug 24 03:07:55.802874 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-1c679fcf-fae7-4846-91dc-fa99387969cd admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:55.895695 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-1c679fcf-fae7-4846-91dc-fa99387969cd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:55.995239 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-1c679fcf-fae7-4846-91dc-fa99387969cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:56.034793 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-1c679fcf-fae7-4846-91dc-fa99387969cd admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=4924e99948124ddba645f01ba230439a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3405190 Aug 24 03:07:56.034793 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c679fcf-fae7-4846-91dc-fa99387969cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=683c244c-259a-424b-93c8-a79904285b77,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:56.035800 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 40908) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:56.090472 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-98e03cde-be12-448a-9ebd-16c7b2e39063 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:56.116209 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-98e03cde-be12-448a-9ebd-16c7b2e39063 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:56.241247 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-98e03cde-be12-448a-9ebd-16c7b2e39063 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:56.244775 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-98e03cde-be12-448a-9ebd-16c7b2e39063 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:56.245959 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-98e03cde-be12-448a-9ebd-16c7b2e39063 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/683c244c-259a-424b-93c8-a79904285b77 HTTP/1.1" status: 204 len: 168 time: 0.2091703 Aug 24 03:07:56.254263 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98e03cde-be12-448a-9ebd-16c7b2e39063 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=683c244c-259a-424b-93c8-a79904285b77,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:56.903042 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-19f3a867-c88d-4eec-a665-d01da2a9f63e req-a1dc0863-2076-4cb1-a9aa-75b357aba238 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 210 time: 0.0398049 Aug 24 03:07:56.972289 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:57.289314 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b53eda3e-f564-40bf-b701-4bb677615056 req-3079e1c8-a049-418b-8f4b-3cbe6e627cce tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:57.291706 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-3079e1c8-a049-418b-8f4b-3cbe6e627cce tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 812 time: 0.1079705 Aug 24 03:07:57.353926 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-a16f6e30-6168-4f0f-a85c-6d308f7a7473 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=03198f839b864099b1c011c0fc54c7dd HTTP/1.1" status: 200 len: 380 time: 0.0507741 Aug 24 03:07:57.362947 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'port': {'device_id': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'admin_state_up': True, 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'security_groups': ['b69cad14-2388-40cc-8cc6-0b7d617b183d']}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:07:57.373673 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40948) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:57.487710 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1331503162-network', 'tenant_id': 'fbbefc7fd316496981f97429e758fab0'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:07:57.560789 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Made reservation on behalf of 03198f839b864099b1c011c0fc54c7dd for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:07:57.564463 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:57.646535 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Made reservation on behalf of fbbefc7fd316496981f97429e758fab0 for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:07:57.648854 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:57.658030 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:57.693828 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Allocated IP 172.20.0.8 (3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6/9d24a59e-1441-41fd-b523-3368836ed9c4/4137bd43-5447-4d24-a225-3161bde7b9ac) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:07:57.749097 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:57.827885 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:57.835946 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:57.860500 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Transition to ACTIVE for port object 4137bd43-5447-4d24-a225-3161bde7b9ac will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:07:57.860651 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] vlan segment allocate from pool success with {'vlan_id': 390, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:07:57.860651 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38ce451a-e1d3-4e54-853f-c2082043e34c,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:57.870254 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:57.870673 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Added segment 1b3b3120-6bd1-4e87-87c1-5cfa372d34ec of type vlan for network a9e050e8-aad7-4bed-b717-eb4d06656830 Aug 24 03:07:57.911123 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:58.000980 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-c36f0488-98bc-400b-a33f-f979eb1be9ed req-66e56136-1ac8-42ba-9707-6e648ca51540 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 210 time: 0.0286074 Aug 24 03:07:58.005359 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:58.005992 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:58.006817 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:58.008439 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:58.066300 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:07:58.071428 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:07:58.076766 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:07:58.082629 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] Pushing event updated for resources: {'Network': ['ID=a9e050e8-aad7-4bed-b717-eb4d06656830,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:58.097176 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network a9e050e8-aad7-4bed-b717-eb4d06656830 details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:07:58.103982 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'Port': ['ID=4137bd43-5447-4d24-a225-3161bde7b9ac,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:58.128681 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:58.129413 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:58.177313 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-348ea1bd-9d5b-4144-b03a-712cbe6f5488 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.8025064 Aug 24 03:07:58.181557 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40958) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:07:58.186679 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-040e4438-257c-4c9c-85df-9f971579fea8 admin admin] Request body: {'subnet': {'network_id': 'a9e050e8-aad7-4bed-b717-eb4d06656830', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1331503162-subnet', 'tenant_id': 'fbbefc7fd316496981f97429e758fab0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:07:58.223339 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-7e34396a-eb75-47bc-abff-8a035f89ec3b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8641093 Aug 24 03:07:58.235823 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Request body: {'port': {'device_id': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:07:58.291074 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:58.406827 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-040e4438-257c-4c9c-85df-9f971579fea8 admin admin] Made reservation on behalf of fbbefc7fd316496981f97429e758fab0 for: {'subnet': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:07:58.409739 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-040e4438-257c-4c9c-85df-9f971579fea8 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3378795'] for subnet, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:58.458137 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-081c04bd-dc3d-482c-b54c-226c9086524c None None] Provisioning for port 4137bd43-5447-4d24-a225-3161bde7b9ac completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:07:58.462630 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-081c04bd-dc3d-482c-b54c-226c9086524c None None] Provisioning complete for port 4137bd43-5447-4d24-a225-3161bde7b9ac triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:07:58.463033 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-081c04bd-dc3d-482c-b54c-226c9086524c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:58.512749 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-081c04bd-dc3d-482c-b54c-226c9086524c None None] Port 4137bd43-5447-4d24-a225-3161bde7b9ac cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:07:58.566016 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4137bd43-5447-4d24-a225-3161bde7b9ac {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:07:58.573413 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:58.584919 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Transition to ACTIVE for port object 4137bd43-5447-4d24-a225-3161bde7b9ac will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:07:58.789839 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:58.790123 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-040e4438-257c-4c9c-85df-9f971579fea8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483122', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3378713'] for subnet, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:58.845007 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040e4438-257c-4c9c-85df-9f971579fea8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5436d568-2f06-495e-84a8-220bad03aac2,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:58.847116 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Pushing event updated for resources: {'Port': ['ID=4137bd43-5447-4d24-a225-3161bde7b9ac,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:58.865316 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-040e4438-257c-4c9c-85df-9f971579fea8 admin admin] Checking segment: {'id': '1b3b3120-6bd1-4e87-87c1-5cfa372d34ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': 'a9e050e8-aad7-4bed-b717-eb4d06656830'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:07:58.865774 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-040e4438-257c-4c9c-85df-9f971579fea8 admin admin] Network hostable DHCP agents. Network: a9e050e8-aad7-4bed-b717-eb4d06656830, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111275) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:07:58.953751 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Attempting to bind port 4137bd43-5447-4d24-a225-3161bde7b9ac on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:07:58.955081 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-040e4438-257c-4c9c-85df-9f971579fea8 admin admin] Network a9e050e8-aad7-4bed-b717-eb4d06656830 is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111275) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:07:58.958211 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Attempting to bind port 4137bd43-5447-4d24-a225-3161bde7b9ac by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:07:58.958885 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Attempting to bind port 4137bd43-5447-4d24-a225-3161bde7b9ac on network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:07:58.963847 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Port 4137bd43-5447-4d24-a225-3161bde7b9ac on network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:07:58.964204 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Attempting to bind port 4137bd43-5447-4d24-a225-3161bde7b9ac on network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:07:58.969159 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 7, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:07:58.969521 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Checking segment: {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:07:58.969913 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Bound using segment: {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:07:58.970365 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Bound port: 4137bd43-5447-4d24-a225-3161bde7b9ac, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fb76a34d-79be-499b-a9c7-0f51849f60f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:07:58.970727 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:59.038210 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] For port 4137bd43-5447-4d24-a225-3161bde7b9ac, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:07:59.042383 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] For port 4137bd43-5447-4d24-a225-3161bde7b9ac, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=4137bd43-5447-4d24-a225-3161bde7b9ac,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:07:59.119399 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d94dcc00-a5a6-454c-afc6-dc6183974fd1 req-8578ae1f-e49d-4762-bb97-fba58c7263e2 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:59.120872 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d94dcc00-a5a6-454c-afc6-dc6183974fd1 req-8578ae1f-e49d-4762-bb97-fba58c7263e2 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 943 time: 0.0495856 Aug 24 03:07:59.124925 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-040e4438-257c-4c9c-85df-9f971579fea8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, a9e050e8-aad7-4bed-b717-eb4d06656830) {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:07:59.131232 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-040e4438-257c-4c9c-85df-9f971579fea8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:59.131232 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-040e4438-257c-4c9c-85df-9f971579fea8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:59.135725 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-629f325e-b988-4b2d-bd92-1a33554dca54 None None] Network a9e050e8-aad7-4bed-b717-eb4d06656830 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:07:59.151700 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:59.169479 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-d94dcc00-a5a6-454c-afc6-dc6183974fd1 req-b6ecd8f9-c3bc-43e3-99e3-bb0e73680a9b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409880 Aug 24 03:07:59.190102 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:59.190808 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:07:59.192793 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-79412f73-79c8-40ef-877e-1048968df408 service neutron] 10.222.0.43 "PUT /v2.0/ports/4137bd43-5447-4d24-a225-3161bde7b9ac HTTP/1.1" status: 200 len: 1093 time: 0.9613268 Aug 24 03:07:59.195662 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'tag': '4137bd43-5447-4d24-a225-3161bde7b9ac'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:07:59.199975 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5a02b496-664c-4169-80d2-b12fabb1d167" -d '{"events": [{"name": "network-changed", "server_uuid": "67b5653d-53be-4bd6-a58f-f8278215abe8", "tag": "4137bd43-5447-4d24-a225-3161bde7b9ac"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:07:59.245926 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:07:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-38b8a6b2-ecfb-4d7f-a358-83417771b44a x-openstack-request-id: req-38b8a6b2-ecfb-4d7f-a358-83417771b44a {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:07:59.252167 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "67b5653d-53be-4bd6-a58f-f8278215abe8", "tag": "4137bd43-5447-4d24-a225-3161bde7b9ac", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:07:59.252167 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-38b8a6b2-ecfb-4d7f-a358-83417771b44a {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:07:59.252167 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'tag': '4137bd43-5447-4d24-a225-3161bde7b9ac', 'status': 'completed', 'code': 200} Aug 24 03:07:59.252167 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79412f73-79c8-40ef-877e-1048968df408 service neutron] Pushing event updated for resources: {'Port': ['ID=4137bd43-5447-4d24-a225-3161bde7b9ac,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:07:59.252528 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-040e4438-257c-4c9c-85df-9f971579fea8 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.0676498 Aug 24 03:07:59.285247 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7ca6fac-47a7-447b-b1df-5fca85e5781e None None] Network a9e050e8-aad7-4bed-b717-eb4d06656830 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:07:59.322631 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a02b496-664c-4169-80d2-b12fabb1d167 req-a6d39880-3598-4447-a200-db50af575cac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:59.324463 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5a02b496-664c-4169-80d2-b12fabb1d167 req-a6d39880-3598-4447-a200-db50af575cac service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 1096 time: 0.0488770 Aug 24 03:07:59.452989 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a02b496-664c-4169-80d2-b12fabb1d167 req-e04db600-7005-4351-bf46-9cef5284e713 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:59.452989 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5a02b496-664c-4169-80d2-b12fabb1d167 req-e04db600-7005-4351-bf46-9cef5284e713 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=03198f839b864099b1c011c0fc54c7dd&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1191533 Aug 24 03:07:59.545904 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a02b496-664c-4169-80d2-b12fabb1d167 req-66b57748-b242-4503-b1c4-988aa5b68109 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:59.547787 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5a02b496-664c-4169-80d2-b12fabb1d167 req-66b57748-b242-4503-b1c4-988aa5b68109 service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0893288 Aug 24 03:07:59.627287 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b53eda3e-f564-40bf-b701-4bb677615056 req-5868f923-cd17-417e-a505-07bcebce5c9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:59.628671 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-5868f923-cd17-417e-a505-07bcebce5c9e service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 1096 time: 0.0449500 Aug 24 03:07:59.671405 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-1d4d0325-240e-452b-8b48-61399c0d9b20 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=4137bd43-5447-4d24-a225-3161bde7b9ac HTTP/1.1" status: 200 len: 217 time: 0.0344260 Aug 24 03:07:59.720419 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b53eda3e-f564-40bf-b701-4bb677615056 req-f8552b0e-cc3b-4703-87fc-d494a457a187 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:59.721906 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-f8552b0e-cc3b-4703-87fc-d494a457a187 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 200 len: 851 time: 0.0442221 Aug 24 03:07:59.771441 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b53eda3e-f564-40bf-b701-4bb677615056 req-061c0326-ddeb-4499-bc91-0f36f4e2a397 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:07:59.772969 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-061c0326-ddeb-4499-bc91-0f36f4e2a397 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0437016 Aug 24 03:07:59.865329 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-27b221e9-0a5a-4439-9f30-521acee0141b service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855472 Aug 24 03:07:59.961446 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b53eda3e-f564-40bf-b701-4bb677615056 req-fe071170-d2b7-4b16-99e8-931829d5eccc service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887527 Aug 24 03:08:00.044369 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40986) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:00.049362 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-625751475-network', 'tenant_id': 'bfda8e4406cc4c1d8afa4b3af7b37b2c'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:00.172277 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Made reservation on behalf of bfda8e4406cc4c1d8afa4b3af7b37b2c for: {'network': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:08:00.174481 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:00.188116 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:00.304645 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:00.313806 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25a659ac-15e5-404e-ba91-29d2893682fc req-2ad3c1f4-49a6-4646-be55-e1e103e3f14b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:00.315251 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-25a659ac-15e5-404e-ba91-29d2893682fc req-2ad3c1f4-49a6-4646-be55-e1e103e3f14b tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 943 time: 0.0742273 Aug 24 03:08:00.351645 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-25a659ac-15e5-404e-ba91-29d2893682fc req-1781b3ca-1f4f-47d2-8260-e285a8732cd3 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303769 Aug 24 03:08:00.383725 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:00.407499 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] vlan segment allocate from pool success with {'vlan_id': 382, 'physical_network': 'physnet1'} {{(pid=111275) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:08:00.416358 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ac38d86-41bf-4e7c-b655-aebc480c6309,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:00.422099 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:00.422550 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.segments_db [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Added segment a4b454a8-08ec-480e-a005-6c493c23c9a4 of type vlan for network 399f0ade-a200-46ea-be0e-b2a119b7b5a9 Aug 24 03:08:00.461347 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:00.561078 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:00.562088 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:00.562666 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:00.624325 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] Pushing event updated for resources: {'Network': ['ID=399f0ade-a200-46ea-be0e-b2a119b7b5a9,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:00.633751 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 399f0ade-a200-46ea-be0e-b2a119b7b5a9 details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:08:00.728987 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a0e23fa5-3c6b-41c4-8bd3-587bd5ed090f admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.6834822 Aug 24 03:08:00.731758 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 40996) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:00.736825 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-056b9733-3729-467d-8e0f-e580149bb881 admin admin] Request body: {'subnet': {'network_id': '399f0ade-a200-46ea-be0e-b2a119b7b5a9', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-625751475-subnet', 'tenant_id': 'bfda8e4406cc4c1d8afa4b3af7b37b2c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:00.913665 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-056b9733-3729-467d-8e0f-e580149bb881 admin admin] Made reservation on behalf of bfda8e4406cc4c1d8afa4b3af7b37b2c for: {'subnet': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:08:00.916666 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-056b9733-3729-467d-8e0f-e580149bb881 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3378795'] for subnet, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:01.165737 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-056b9733-3729-467d-8e0f-e580149bb881 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483122', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3378713'] for subnet, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:01.219887 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-056b9733-3729-467d-8e0f-e580149bb881 admin admin] Pushing event updated for resources: {'Subnet': ['ID=34a86e1c-cefc-4081-b96d-c9e1f04e9e90,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:01.229048 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-056b9733-3729-467d-8e0f-e580149bb881 admin admin] Checking segment: {'id': 'a4b454a8-08ec-480e-a005-6c493c23c9a4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 382, 'network_id': '399f0ade-a200-46ea-be0e-b2a119b7b5a9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:08:01.229397 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-056b9733-3729-467d-8e0f-e580149bb881 admin admin] Network hostable DHCP agents. Network: 399f0ade-a200-46ea-be0e-b2a119b7b5a9, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111275) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:08:01.303904 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-056b9733-3729-467d-8e0f-e580149bb881 admin admin] Network 399f0ade-a200-46ea-be0e-b2a119b7b5a9 is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111275) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:08:01.401221 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-056b9733-3729-467d-8e0f-e580149bb881 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 399f0ade-a200-46ea-be0e-b2a119b7b5a9) {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:01.407840 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-056b9733-3729-467d-8e0f-e580149bb881 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:01.408530 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-056b9733-3729-467d-8e0f-e580149bb881 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:01.409523 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78167477-5725-4d58-930c-f63df1b6678b None None] Network 399f0ade-a200-46ea-be0e-b2a119b7b5a9 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:08:01.475092 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-286f923e-b5ea-4b54-91dc-3fece1ea3f06 req-95694e8b-8cf4-4958-b85e-531a218dd306 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:01.476565 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-286f923e-b5ea-4b54-91dc-3fece1ea3f06 req-95694e8b-8cf4-4958-b85e-531a218dd306 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 943 time: 0.0507128 Aug 24 03:08:01.493621 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-056b9733-3729-467d-8e0f-e580149bb881 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 0.7600865 Aug 24 03:08:01.516098 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-286f923e-b5ea-4b54-91dc-3fece1ea3f06 req-918ded27-3f49-40f1-8de5-012642f0542c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0334105 Aug 24 03:08:01.539949 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75a582d1-23b5-4e4b-9249-02538f5225a1 None None] Network 399f0ade-a200-46ea-be0e-b2a119b7b5a9 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:08:01.618229 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41002) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:01.661074 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_v2 [None req-69929798-4271-4b87-902a-472fa4bf0735 admin admin] Deleting subnet 5436d568-2f06-495e-84a8-220bad03aac2 {{(pid=111276) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:08:01.664274 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-69929798-4271-4b87-902a-472fa4bf0735 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:01.697851 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-69929798-4271-4b87-902a-472fa4bf0735 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25761351'] for subnet, precommit_delete_associations {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:01.739440 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-69929798-4271-4b87-902a-472fa4bf0735 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:01.876001 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-69929798-4271-4b87-902a-472fa4bf0735 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3525669', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25854754'] for subnet, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:01.903768 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69929798-4271-4b87-902a-472fa4bf0735 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5436d568-2f06-495e-84a8-220bad03aac2,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:01.908523 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-69929798-4271-4b87-902a-472fa4bf0735 admin admin] Notify callbacks [] for subnet, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:01.910362 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-69929798-4271-4b87-902a-472fa4bf0735 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/5436d568-2f06-495e-84a8-220bad03aac2 HTTP/1.1" status: 204 len: 168 time: 0.2910409 Aug 24 03:08:01.912896 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41008) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:01.981363 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.065049 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.074912 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a9e050e8-aad7-4bed-b717-eb4d06656830']}} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:02.084768 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1b3b3120-6bd1-4e87-87c1-5cfa372d34ec') {'for_net_delete': True} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:02.085062 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1b3b3120-6bd1-4e87-87c1-5cfa372d34ec') {} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:02.093897 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25761368'] for segment, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.107857 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.113638 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] Releasing vlan 390 on physical network physnet1 to pool {{(pid=111276) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:08:02.114069 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3525699'] for segment, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: Traceback (most recent call last): Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: timer() Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: cb(*args, **kw) Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: return func(*args, **kwargs) Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: self._notify() Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: self.callback(batched_events) Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: event.method(event) Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: return f(self, *a, **k) Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._get(url).json() Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: return self.request(url, 'GET', **kwargs) Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:08:02.115766 dv-cinder-803748-8-iscsi neutron-server[111276]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:08:02.252503 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.257900 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.260175 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] 10.222.0.30 "DELETE /v2.0/networks/a9e050e8-aad7-4bed-b717-eb4d06656830 HTTP/1.1" status: 204 len: 168 time: 0.3463500 Aug 24 03:08:02.263323 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41012) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:02.271574 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cbf2d7c-d204-451f-a4a1-987073916c49 admin admin] Pushing event deleted for resources: {'Network': ['ID=a9e050e8-aad7-4bed-b717-eb4d06656830,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:02.310060 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-08597a6a-6bcd-4754-82b8-d6ddd3034f56 admin admin] Deleting subnet 34a86e1c-cefc-4081-b96d-c9e1f04e9e90 {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:08:02.313041 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-08597a6a-6bcd-4754-82b8-d6ddd3034f56 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.350022 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-08597a6a-6bcd-4754-82b8-d6ddd3034f56 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.387731 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-08597a6a-6bcd-4754-82b8-d6ddd3034f56 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.508202 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-08597a6a-6bcd-4754-82b8-d6ddd3034f56 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.535447 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08597a6a-6bcd-4754-82b8-d6ddd3034f56 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=34a86e1c-cefc-4081-b96d-c9e1f04e9e90,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:02.537727 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-08597a6a-6bcd-4754-82b8-d6ddd3034f56 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.539839 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-08597a6a-6bcd-4754-82b8-d6ddd3034f56 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/34a86e1c-cefc-4081-b96d-c9e1f04e9e90 HTTP/1.1" status: 204 len: 168 time: 0.2749505 Aug 24 03:08:02.542610 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41016) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:02.639743 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.661477 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e6ea546-0e5b-4579-84b1-52e199092ecf req-965dfc8f-c20f-4331-abde-804cafde3bad tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:02.662976 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1e6ea546-0e5b-4579-84b1-52e199092ecf req-965dfc8f-c20f-4331-abde-804cafde3bad tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 943 time: 0.0735571 Aug 24 03:08:02.758502 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.769722 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-1e6ea546-0e5b-4579-84b1-52e199092ecf req-75bad7f1-5cde-4724-863c-a88ca70341b1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0864906 Aug 24 03:08:02.772816 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['399f0ade-a200-46ea-be0e-b2a119b7b5a9']}} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:02.782829 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a4b454a8-08ec-480e-a005-6c493c23c9a4') {'for_net_delete': True} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:02.783135 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a4b454a8-08ec-480e-a005-6c493c23c9a4') {} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:02.792699 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25719248'] for segment, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.805356 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.811109 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] Releasing vlan 382 on physical network physnet1 to pool {{(pid=111275) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:08:02.811493 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3484247'] for segment, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: Traceback (most recent call last): Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: timer() Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: cb(*args, **kw) Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: return func(*args, **kwargs) Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: self._notify() Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: self.callback(batched_events) Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: event.method(event) Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: return f(self, *a, **k) Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._get(url).json() Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: return self.request(url, 'GET', **kwargs) Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:08:02.813067 dv-cinder-803748-8-iscsi neutron-server[111275]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:08:02.936336 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.940447 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:02.942662 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] 10.222.0.30 "DELETE /v2.0/networks/399f0ade-a200-46ea-be0e-b2a119b7b5a9 HTTP/1.1" status: 204 len: 168 time: 0.3990414 Aug 24 03:08:02.955009 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbaf3d62-36d2-4ac7-a232-872789054d9a admin admin] Pushing event deleted for resources: {'Network': ['ID=399f0ade-a200-46ea-be0e-b2a119b7b5a9,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:03.655789 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41024) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:03.695338 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-5c3fd8de-f612-4a48-b1b4-bce7e5326224 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=fbbefc7fd316496981f97429e758fab0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0384023 Aug 24 03:08:03.697791 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41026) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:03.749510 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bb29486e-411d-4d59-8473-eb46981762c4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:03.769822 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bb29486e-411d-4d59-8473-eb46981762c4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:03.807725 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41032) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:03.886282 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-776c6518-4226-4294-b7bc-14dad14a26f5 req-ed416406-17d3-45d4-920f-5e728d506e4e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:03.887778 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-776c6518-4226-4294-b7bc-14dad14a26f5 req-ed416406-17d3-45d4-920f-5e728d506e4e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 943 time: 0.0494456 Aug 24 03:08:03.910689 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bb29486e-411d-4d59-8473-eb46981762c4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:03.913259 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-bb29486e-411d-4d59-8473-eb46981762c4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:03.917392 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-bb29486e-411d-4d59-8473-eb46981762c4 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/38ce451a-e1d3-4e54-853f-c2082043e34c HTTP/1.1" status: 204 len: 168 time: 0.2156935 Aug 24 03:08:03.924138 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8a21116-db1e-48ff-9a94-6aa069aac1dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:03.927222 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-776c6518-4226-4294-b7bc-14dad14a26f5 req-33b0836d-209d-4719-a333-071150b01eb3 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0333245 Aug 24 03:08:03.936423 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb29486e-411d-4d59-8473-eb46981762c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38ce451a-e1d3-4e54-853f-c2082043e34c,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:04.030934 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8a21116-db1e-48ff-9a94-6aa069aac1dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:04.131940 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8a21116-db1e-48ff-9a94-6aa069aac1dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:04.170956 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a8a21116-db1e-48ff-9a94-6aa069aac1dd admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=5f0d6ad8df494f9cb0a0dca963b29c86&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3621588 Aug 24 03:08:04.171832 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a21116-db1e-48ff-9a94-6aa069aac1dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e621de12-4046-4d04-b19a-0dc89851724d,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:04.173814 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41038) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:04.221767 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-37dcac8f-4c14-4194-af51-571f81a473a5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:04.242920 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-37dcac8f-4c14-4194-af51-571f81a473a5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:04.372398 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-37dcac8f-4c14-4194-af51-571f81a473a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:04.375053 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-37dcac8f-4c14-4194-af51-571f81a473a5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:04.376198 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-37dcac8f-4c14-4194-af51-571f81a473a5 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e621de12-4046-4d04-b19a-0dc89851724d HTTP/1.1" status: 204 len: 168 time: 0.2014010 Aug 24 03:08:04.384289 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37dcac8f-4c14-4194-af51-571f81a473a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e621de12-4046-4d04-b19a-0dc89851724d,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:04.654500 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41044) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:04.696534 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-f5e7be01-629f-438c-a1ea-44e6f2dde1d2 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=bfda8e4406cc4c1d8afa4b3af7b37b2c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0407104 Aug 24 03:08:04.698701 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41046) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:04.748408 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d62d8272-d58a-42c4-a672-7295f1803045 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:04.774062 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d62d8272-d58a-42c4-a672-7295f1803045 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:04.903746 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d62d8272-d58a-42c4-a672-7295f1803045 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:04.906325 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d62d8272-d58a-42c4-a672-7295f1803045 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:04.907495 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-d62d8272-d58a-42c4-a672-7295f1803045 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/1ac38d86-41bf-4e7c-b655-aebc480c6309 HTTP/1.1" status: 204 len: 168 time: 0.2079055 Aug 24 03:08:04.915789 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d62d8272-d58a-42c4-a672-7295f1803045 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ac38d86-41bf-4e7c-b655-aebc480c6309,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:05.050397 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57d271fe-c78d-4d89-be73-f492fe37b2be req-703c1d93-48ca-4e81-a706-a80140f280c2 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:05.051870 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-57d271fe-c78d-4d89-be73-f492fe37b2be req-703c1d93-48ca-4e81-a706-a80140f280c2 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 943 time: 0.0524745 Aug 24 03:08:05.091863 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-57d271fe-c78d-4d89-be73-f492fe37b2be req-64107b04-0fc4-45bf-a291-90dbc1316df2 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0331218 Aug 24 03:08:05.521854 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41080) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:05.616854 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1751136595-network', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:05.709629 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Made reservation on behalf of a74f1fd1896c4ed09ff280398fa2440f for: {'network': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:08:05.712687 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:05.726009 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:05.806958 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:05.881011 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:05.906766 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] vlan segment allocate from pool success with {'vlan_id': 350, 'physical_network': 'physnet1'} {{(pid=111276) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:08:05.916046 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9abe615f-f88c-4d6c-97fa-2384752d2c4b,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:05.923102 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:05.923531 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.segments_db [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Added segment d71e524b-5651-4545-b1cf-eda4cfb942c6 of type vlan for network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b Aug 24 03:08:05.966723 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:06.096271 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:06.097720 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:06.098294 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:06.159254 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] Pushing event updated for resources: {'Network': ['ID=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:06.170260 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:08:06.199037 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-c77f5c77-fba3-4a3b-9331-0baf239321cc admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.6760724 Aug 24 03:08:06.202336 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41098) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:06.207953 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-3cae9ba2-4037-449d-b168-ed50343abae4 admin admin] Request body: {'subnet': {'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1751136595-subnet', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'ip_version': 4}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:06.219477 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55670e95-510f-48c2-b81f-2d4fa7b7e770 req-ca2340e5-5316-4702-a88c-a113bc70bbb9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:06.220923 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-55670e95-510f-48c2-b81f-2d4fa7b7e770 req-ca2340e5-5316-4702-a88c-a113bc70bbb9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 943 time: 0.0573416 Aug 24 03:08:06.263189 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-55670e95-510f-48c2-b81f-2d4fa7b7e770 req-fd9409ab-2c34-4288-9df6-1902aa386944 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0341487 Aug 24 03:08:06.307669 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3cae9ba2-4037-449d-b168-ed50343abae4 admin admin] Made reservation on behalf of a74f1fd1896c4ed09ff280398fa2440f for: {'subnet': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:08:06.310076 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3cae9ba2-4037-449d-b168-ed50343abae4 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3378795'] for subnet, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:06.750517 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 4137bd43-5447-4d24-a225-3161bde7b9ac details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:08:06.782172 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3cae9ba2-4037-449d-b168-ed50343abae4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483122', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3378713'] for subnet, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:06.842665 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cae9ba2-4037-449d-b168-ed50343abae4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f42fa902-0e1e-4185-b486-54648ea18f14,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:06.852927 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cae9ba2-4037-449d-b168-ed50343abae4 admin admin] Checking segment: {'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:08:06.853452 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3cae9ba2-4037-449d-b168-ed50343abae4 admin admin] Network hostable DHCP agents. Network: ae628e21-d19e-4dd7-aa51-fd72f4db7e1b, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111275) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:08:06.856731 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 4137bd43-5447-4d24-a225-3161bde7b9ac, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=4137bd43-5447-4d24-a225-3161bde7b9ac,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:06.867160 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '4137bd43-5447-4d24-a225-3161bde7b9ac', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'port_id': '4137bd43-5447-4d24-a225-3161bde7b9ac', 'mac_address': 'fa:16:3e:24:56:83', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 385, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:08:06.908276 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:06.921958 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4137bd43-5447-4d24-a225-3161bde7b9ac {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:08:06.941793 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 4137bd43-5447-4d24-a225-3161bde7b9ac, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=4137bd43-5447-4d24-a225-3161bde7b9ac,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:06.955519 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3cae9ba2-4037-449d-b168-ed50343abae4 admin admin] Network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111275) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:08:07.035348 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.069710 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-3cae9ba2-4037-449d-b168-ed50343abae4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, ae628e21-d19e-4dd7-aa51-fd72f4db7e1b) {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:07.081527 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8303dfaf-92e8-4780-a656-9306e5f41ce3 None None] Network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:08:07.081818 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3cae9ba2-4037-449d-b168-ed50343abae4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:07.082489 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3cae9ba2-4037-449d-b168-ed50343abae4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.097849 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=4137bd43-5447-4d24-a225-3161bde7b9ac,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:07.135964 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:07.136319 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:07.136777 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:07.137301 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:07.137669 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:07.138010 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:07.138343 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:07.138686 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:07.139017 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:07.139348 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:07.139675 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:07.140001 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:07.179203 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-3cae9ba2-4037-449d-b168-ed50343abae4 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.9752231 Aug 24 03:08:07.182589 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41120) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:07.186590 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:07.253150 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc8ebca0a-8efd-5c96-8278-1a4ec08c6f82-ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'fixed_ips': [{'subnet_id': 'f42fa902-0e1e-4185-b486-54648ea18f14'}]}} from dv-cinder-803748-8-iscsi. {{(pid=111277) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Aug 24 03:08:07.254057 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.281262 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-560365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32717'] for router, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.283045 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-560249', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-569518', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-437890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32692'] for router, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.326455 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['4137bd43-5447-4d24-a225-3161bde7b9ac'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:08:07.341772 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.395074 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee57bfc-6ffd-41b4-aac0-e455cda8073c req-4bf4b004-dd1d-43ff-aa00-89ca605059a5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:07.396681 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fee57bfc-6ffd-41b4-aac0-e455cda8073c req-4bf4b004-dd1d-43ff-aa00-89ca605059a5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 944 time: 0.0534201 Aug 24 03:08:07.456655 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.db_base_plugin_common [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Allocated IP 172.20.0.2 (ae628e21-d19e-4dd7-aa51-fd72f4db7e1b/f42fa902-0e1e-4185-b486-54648ea18f14/8f7e065f-ade9-4562-a7d4-6fa0d38faa3b) {{(pid=111277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:08:07.528122 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fee57bfc-6ffd-41b4-aac0-e455cda8073c req-aff0caf0-4d04-49e6-aae7-97061c95040f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0946729 Aug 24 03:08:07.563246 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.689701 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Notify callbacks [] for port, precommit_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.710990 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Transition to ACTIVE for port object 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:07.746073 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Transition to ACTIVE for port object 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b will not be triggered until provisioned by entity DHCP. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:07.828531 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.832205 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.852663 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.866227 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b is already hosted by enough agents. {{(pid=111277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:08:07.869154 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.base_scheduler [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Resources bound (agent type, host, resource id): {{(pid=111277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:07.872525 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Received port after_create {{(pid=111277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:08:07.887965 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Pushing event updated for resources: {'Port': ['ID=8f7e065f-ade9-4562-a7d4-6fa0d38faa3b,revision_number=1']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:07.934670 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Attempting to bind port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:08:07.935037 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Attempting to bind port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:08:07.935394 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Attempting to bind port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b on network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:08:07.940938 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 7, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:08:07.941322 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Checking segment: {'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:08:07.941731 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.942111 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Bound using segment: {'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:08:07.942567 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Bound port: 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:08:07.942937 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:07.965079 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Allocated IP 172.27.2.192 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/76b67021-ef4b-4cc2-a84c-5373ca0abbb2) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:08:08.005986 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] For port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:08:08.009443 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] For port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=8f7e065f-ade9-4562-a7d4-6fa0d38faa3b,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:08:08.069561 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:08.096624 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:08.263014 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:08.280947 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efb62f7a-f970-475f-ac11-79bc685487b7 None None] Pushing event updated for resources: {'Port': ['ID=8f7e065f-ade9-4562-a7d4-6fa0d38faa3b,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:08.313983 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:08:08.316846 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:08.319294 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:08:08.346407 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Pushing event updated for resources: {'Port': ['ID=76b67021-ef4b-4cc2-a84c-5373ca0abbb2,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:08.623988 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:08.652124 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07274f3d-c4c5-4baa-a784-24b69030754d req-9565c7d3-5cbf-498a-bafa-2333739d0138 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:08.671705 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-07274f3d-c4c5-4baa-a784-24b69030754d req-9565c7d3-5cbf-498a-bafa-2333739d0138 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 944 time: 0.0542929 Aug 24 03:08:08.691845 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-07274f3d-c4c5-4baa-a784-24b69030754d req-add6c152-6b42-48f7-9ebe-9650c0c62d54 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322328 Aug 24 03:08:08.695530 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:08.750007 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 4137bd43-5447-4d24-a225-3161bde7b9ac up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:08.878704 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 4137bd43-5447-4d24-a225-3161bde7b9ac completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:08.883260 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 4137bd43-5447-4d24-a225-3161bde7b9ac triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:08.884635 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:08.903489 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-560242', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-569595'] for router, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:08.973794 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:08.999954 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4137bd43-5447-4d24-a225-3161bde7b9ac'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:08:09.002266 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46f5773e-f996-4830-b33b-7f275eb78e54" -d '{"events": [{"server_uuid": "67b5653d-53be-4bd6-a58f-f8278215abe8", "name": "network-vif-plugged", "status": "completed", "tag": "4137bd43-5447-4d24-a225-3161bde7b9ac"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:08:09.016129 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 4137bd43-5447-4d24-a225-3161bde7b9ac, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=4137bd43-5447-4d24-a225-3161bde7b9ac,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:09.046194 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:08:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c2c78dec-2af1-4c85-84f9-472ee9deb60a x-openstack-request-id: req-c2c78dec-2af1-4c85-84f9-472ee9deb60a {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:08:09.046492 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "67b5653d-53be-4bd6-a58f-f8278215abe8", "name": "network-vif-plugged", "status": "completed", "tag": "4137bd43-5447-4d24-a225-3161bde7b9ac", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:08:09.046744 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c2c78dec-2af1-4c85-84f9-472ee9deb60a {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:08:09.047141 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4137bd43-5447-4d24-a225-3161bde7b9ac', 'code': 200} Aug 24 03:08:09.124973 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:09.178513 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=4137bd43-5447-4d24-a225-3161bde7b9ac,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:09.202090 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:09.246714 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 is scheduled to L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 with binding_index 1 {{(pid=111275) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Aug 24 03:08:09.265315 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da752a8e-9e16-444c-a774-7e62e142a289 None None] Network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:08:09.349076 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:09.355386 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:08:09.381069 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Sync routers for ids ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:08:09.400894 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Routers {'e1d42a7b-c203-472f-94cb-e31f4ffab5c6'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:09.401518 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:07:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:09.529361 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Set router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:09.538584 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] Notify callbacks [] for router, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:09.542632 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-e4d118e7-65d7-40c2-9e02-9a39bf4ad8ad admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.3567042 Aug 24 03:08:09.543315 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41146) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:09.571395 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-47dfc65c-9362-4447-a371-3758a68696e4 None None] Provisioning for port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:09.641795 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-47dfc65c-9362-4447-a371-3758a68696e4 None None] Provisioning complete for port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:09.642169 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-47dfc65c-9362-4447-a371-3758a68696e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:09.683573 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d3f98d-4243-4d1c-b484-8504d5d07963 req-eb96d0ba-c964-4399-9661-3c656f9839a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:09.685188 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-09d3f98d-4243-4d1c-b484-8504d5d07963 req-eb96d0ba-c964-4399-9661-3c656f9839a1 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 1098 time: 0.0971859 Aug 24 03:08:09.785620 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-47dfc65c-9362-4447-a371-3758a68696e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:09.787265 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-09d3f98d-4243-4d1c-b484-8504d5d07963 req-c32c2d9d-ba87-4494-a2c7-e4b49119519d service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0941041 Aug 24 03:08:09.824466 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-47dfc65c-9362-4447-a371-3758a68696e4 None None] For port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=8f7e065f-ade9-4562-a7d4-6fa0d38faa3b,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:09.828344 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:08Z', 'revision_number': 3, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:07Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:09.859155 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Checking router: e1d42a7b-c203-472f-94cb-e31f4ffab5c6 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:08:09.859405 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Updating router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 port 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 binding host dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:08:09.877058 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de06c76e-6aa9-4168-b67f-56bff1119f87 req-d0860dc0-70c6-4602-b905-7849d2905731 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:09.878569 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-de06c76e-6aa9-4168-b67f-56bff1119f87 req-d0860dc0-70c6-4602-b905-7849d2905731 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 945 time: 0.0851357 Aug 24 03:08:09.885907 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:09.922846 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-47dfc65c-9362-4447-a371-3758a68696e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:09.957518 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-de06c76e-6aa9-4168-b67f-56bff1119f87 req-3c11e822-c3ec-4f03-8da4-efb1e5f69c91 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431266 Aug 24 03:08:10.028164 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47dfc65c-9362-4447-a371-3758a68696e4 None None] Pushing event updated for resources: {'Port': ['ID=8f7e065f-ade9-4562-a7d4-6fa0d38faa3b,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:10.090825 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-b209c60d-cdb3-4432-b39a-0c6df4c096b4 None None] Provisioning complete for port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:10.091224 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-b209c60d-cdb3-4432-b39a-0c6df4c096b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:10.154009 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:10.259335 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Notify callbacks [] for port, precommit_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:10.269159 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Transition to ACTIVE for port object 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:10.312675 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Allocated IP 172.20.0.1 (ae628e21-d19e-4dd7-aa51-fd72f4db7e1b/f42fa902-0e1e-4185-b486-54648ea18f14/ed6e0056-5b12-4208-94e0-7ff36c2102a7) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:08:10.377978 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:10.416047 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:10.429654 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Transition to ACTIVE for port object ed6e0056-5b12-4208-94e0-7ff36c2102a7 will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:10.434255 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Attempting to bind port 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:08:10.434626 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Attempting to bind port 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:08:10.434984 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Attempting to bind port 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 on network 63097abe-4b2c-457b-a244-629c1feb1fe5 {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:08:10.436933 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eba6dcb8-1474-4216-a872-34850013d13a None None] Pushing event updated for resources: {'Port': ['ID=76b67021-ef4b-4cc2-a84c-5373ca0abbb2,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:10.442574 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 7, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:08:10.442946 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Checking segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:08:10.443905 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:10.443905 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Bound using segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:08:10.444155 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Bound port: 76b67021-ef4b-4cc2-a84c-5373ca0abbb2, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:08:10.444529 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:10.497299 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] For port 76b67021-ef4b-4cc2-a84c-5373ca0abbb2, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:08:10.500650 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] For port 76b67021-ef4b-4cc2-a84c-5373ca0abbb2, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=76b67021-ef4b-4cc2-a84c-5373ca0abbb2,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:08:10.542306 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:10.582209 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:10.583412 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:08:10.586196 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:10.590263 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:08:10.614875 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Pushing event updated for resources: {'Port': ['ID=ed6e0056-5b12-4208-94e0-7ff36c2102a7,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:10.655572 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Routers {'e1d42a7b-c203-472f-94cb-e31f4ffab5c6'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:10.655771 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-571748'] for router_interface, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:10.656439 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:07:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:10.699113 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eba6dcb8-1474-4216-a872-34850013d13a None None] Pushing event updated for resources: {'Port': ['ID=76b67021-ef4b-4cc2-a84c-5373ca0abbb2,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:10.797256 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] Set router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:10.917971 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:10.981113 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-05a0770a-46cf-404d-8f65-6a948f893ae6 None None] Provisioning for port ed6e0056-5b12-4208-94e0-7ff36c2102a7 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:10.986905 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-05a0770a-46cf-404d-8f65-6a948f893ae6 None None] Provisioning complete for port ed6e0056-5b12-4208-94e0-7ff36c2102a7 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:10.987418 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-05a0770a-46cf-404d-8f65-6a948f893ae6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:11.106984 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:11.131837 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbcdec8d-0e16-47d2-bf90-bec5ebdccd5d req-d6316eb0-4501-48bf-98ab-34770d1f6df9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:11.134448 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fbcdec8d-0e16-47d2-bf90-bec5ebdccd5d req-d6316eb0-4501-48bf-98ab-34770d1f6df9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 945 time: 0.0689862 Aug 24 03:08:11.167713 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:08Z', 'revision_number': 3, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:11.178864 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fbcdec8d-0e16-47d2-bf90-bec5ebdccd5d req-1454367c-dff5-496c-9bb9-e44dffdc5bda tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0372968 Aug 24 03:08:11.181913 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:11.199947 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:11.201695 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-05a0770a-46cf-404d-8f65-6a948f893ae6 None None] Port ed6e0056-5b12-4208-94e0-7ff36c2102a7 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:08:11.205132 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ff9dcf3-cd26-4611-aca7-1f4e5426cf53 None None] The sync data for ids ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'] in dv-cinder-803748-8-iscsi is: [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:08Z', 'revision_number': 3, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:08:11.234946 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-748278', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-571822'] for router_interface, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:11.261519 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:11.262190 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:11.299585 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Pushing event updated for resources: {'Port': ['ID=ed6e0056-5b12-4208-94e0-7ff36c2102a7,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:11.649541 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c33440-da34-476c-8b24-bb630fc1b161 req-5de75d6b-997d-474c-9f5e-efd839f86445 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:11.651080 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-34c33440-da34-476c-8b24-bb630fc1b161 req-5de75d6b-997d-474c-9f5e-efd839f86445 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 945 time: 0.3668413 Aug 24 03:08:11.685993 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:08:11.688315 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:11.706995 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-34c33440-da34-476c-8b24-bb630fc1b161 req-e2702cf9-321c-4f54-aa16-598b58587a50 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490422 Aug 24 03:08:11.732267 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41180) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:11.779459 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f37f242-8d42-4ca9-a044-9029a385b0f5 tempest-TestVolumeBootPattern-1918149566 tempest-TestVolumeBootPattern-1918149566-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:11.781400 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-5f37f242-8d42-4ca9-a044-9029a385b0f5 tempest-TestVolumeBootPattern-1918149566 tempest-TestVolumeBootPattern-1918149566-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 1093 time: 0.0479412 Aug 24 03:08:11.784301 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41182) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:11.789284 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Request body: {'floatingip': {'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'port_id': '4137bd43-5447-4d24-a225-3161bde7b9ac', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address': '172.20.0.8'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:11.819598 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:08:11.919174 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:11.931578 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-63e4d711-4449-4f0a-9396-a8e50186a169 None None] Provisioning complete for port ed6e0056-5b12-4208-94e0-7ff36c2102a7 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:11.932185 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-63e4d711-4449-4f0a-9396-a8e50186a169 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:11.946466 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:08:11.952989 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-b2320d15-4fd1-4778-a6c2-e35a23c5941c admin admin] 10.222.0.30 "PUT /v2.0/routers/e1d42a7b-c203-472f-94cb-e31f4ffab5c6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4085951 Aug 24 03:08:11.995104 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-63e4d711-4449-4f0a-9396-a8e50186a169 None None] Port ed6e0056-5b12-4208-94e0-7ff36c2102a7 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:08:12.051960 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:12.174211 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Allocated IP 172.27.2.131 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/2ec6506e-0834-429a-9737-e04b39a5cfba) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:08:12.282142 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:12.430158 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:12.468204 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:08:12.471231 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:12.474430 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:08:12.502442 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'Port': ['ID=2ec6506e-0834-429a-9737-e04b39a5cfba,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:12.690857 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41204) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:12.863837 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41212) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:12.869928 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-349617832-network', 'tenant_id': '849103eb110a4cd69c63067564c4696e'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:12.875051 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Sync routers for ids ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:08:12.879882 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-65f5d436-b5ca-4b2a-b99e-82090c28bcf0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:12.885826 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Routers {'e1d42a7b-c203-472f-94cb-e31f4ffab5c6'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:12.886611 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:07:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:12.906643 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.db.api [None req-65f5d436-b5ca-4b2a-b99e-82090c28bcf0 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Aug 24 03:08:12.906643 dv-cinder-803748-8-iscsi neutron-server[111276]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Aug 24 03:08:12.906643 dv-cinder-803748-8-iscsi neutron-server[111276]: [parameters: {'project_id_1': '5b752bbe3b0e44668f638f56addd4cc7', 'expiration_1': datetime.datetime(2021, 8, 24, 3, 8, 12, 897385)}] Aug 24 03:08:12.906643 dv-cinder-803748-8-iscsi neutron-server[111276]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=111276) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Aug 24 03:08:12.907161 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG oslo_db.api [None req-65f5d436-b5ca-4b2a-b99e-82090c28bcf0 admin admin] Performing DB retry for function neutron.db.securitygroups_db.SecurityGroupDbMixin.create_security_group {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Aug 24 03:08:13.000155 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Set router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:13.050133 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Made reservation on behalf of 849103eb110a4cd69c63067564c4696e for: {'network': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:08:13.053492 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.063097 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.147495 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.196471 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.196946 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:13.260375 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 4, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'ed6e0056-5b12-4208-94e0-7ff36c2102a7', 'name': '', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'mac_address': 'fa:16:3e:97:c7:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_interface', 'standard_attr_id': 641, 'fixed_ips': [{'subnet_id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:10Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 2, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'subnets': [{'id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:13.284150 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.286204 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Checking router: e1d42a7b-c203-472f-94cb-e31f4ffab5c6 for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:08:13.286558 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Updating router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 port ed6e0056-5b12-4208-94e0-7ff36c2102a7 binding host dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:08:13.310755 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.318989 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.342000 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] vlan segment allocate from pool success with {'vlan_id': 387, 'physical_network': 'physnet1'} {{(pid=111276) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:08:13.349621 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:13.354261 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:13.354642 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.370058 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.371002 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.segments_db [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Added segment 4008e385-fd85-46e6-ae27-b19d14c888fd of type vlan for network 0ea0c802-0090-450d-babb-4d8c5dbdbc8f Aug 24 03:08:13.438162 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.446281 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for port, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.448159 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.465099 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-65f5d436-b5ca-4b2a-b99e-82090c28bcf0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.468625 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port 76b67021-ef4b-4cc2-a84c-5373ca0abbb2, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=76b67021-ef4b-4cc2-a84c-5373ca0abbb2,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:13.476520 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2208264b-4895-45b2-9784-cfb20a1e69f3,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:13.526467 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3484283'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.555595 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.574055 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Notify callbacks [] for port, precommit_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.577511 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.579049 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:13.579859 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.584006 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.provisioning_blocks [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Transition to ACTIVE for port object ed6e0056-5b12-4208-94e0-7ff36c2102a7 will not be triggered until provisioned by entity L2. {{(pid=111278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:13.591030 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-65f5d436-b5ca-4b2a-b99e-82090c28bcf0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.607474 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=76b67021-ef4b-4cc2-a84c-5373ca0abbb2,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:13.622227 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event updated for resources: {'Port': ['ID=2ec6506e-0834-429a-9737-e04b39a5cfba,revision_number=2']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:13.629938 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.648555 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] Pushing event updated for resources: {'Network': ['ID=0ea0c802-0090-450d-babb-4d8c5dbdbc8f,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:13.652370 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.660882 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network 0ea0c802-0090-450d-babb-4d8c5dbdbc8f details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:08:13.687646 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-65f5d436-b5ca-4b2a-b99e-82090c28bcf0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.737756 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41214) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:13.738004 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-65f5d436-b5ca-4b2a-b99e-82090c28bcf0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=5b752bbe3b0e44668f638f56addd4cc7&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0449460 Aug 24 03:08:13.738776 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f5d436-b5ca-4b2a-b99e-82090c28bcf0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd408f56-a193-4323-8cea-02fd6b22bbe9,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:13.752925 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-8b853498-178a-46fe-8de2-29a89e916fed admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.8850925 Aug 24 03:08:13.752925 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41216) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:13.766020 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-8ac8ceee-3d74-476a-8a33-c7b653f92f04 admin admin] Request body: {'subnet': {'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-349617832-subnet', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'ip_version': 4}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:13.766597 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.l3_db [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Floating IP dac795f4-6bda-4417-aa85-44e7c2f1e1b4 associated. External IP: 172.27.2.131, port: 4137bd43-5447-4d24-a225-3161bde7b9ac. Aug 24 03:08:13.792640 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Pushing event updated for resources: {'Port': ['ID=ed6e0056-5b12-4208-94e0-7ff36c2102a7,revision_number=3']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:13.806189 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:13.807045 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:13.807045 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:13.807443 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:13.807779 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:13.807985 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:13.808310 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:13.808632 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:13.808953 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:13.809270 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:13.809626 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:13.809944 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111278) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:13.838437 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c552149c-8a7f-4f1a-b363-8aff5b00d6b1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.863639 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8ac8ceee-3d74-476a-8a33-c7b653f92f04 admin admin] Made reservation on behalf of 849103eb110a4cd69c63067564c4696e for: {'subnet': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:08:13.866049 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8ac8ceee-3d74-476a-8a33-c7b653f92f04 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25854793'] for subnet, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.882575 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Attempting to bind port ed6e0056-5b12-4208-94e0-7ff36c2102a7 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:08:13.883216 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Attempting to bind port ed6e0056-5b12-4208-94e0-7ff36c2102a7 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:08:13.883700 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Attempting to bind port ed6e0056-5b12-4208-94e0-7ff36c2102a7 on network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:08:13.890471 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 7, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:08:13.890880 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Checking segment: {'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:08:13.892409 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.892409 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Bound using segment: {'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:08:13.892654 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c552149c-8a7f-4f1a-b363-8aff5b00d6b1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.893280 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Bound port: ed6e0056-5b12-4208-94e0-7ff36c2102a7, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'}}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:08:13.893881 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:13.969854 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] For port ed6e0056-5b12-4208-94e0-7ff36c2102a7, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:08:13.974265 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] For port ed6e0056-5b12-4208-94e0-7ff36c2102a7, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=ed6e0056-5b12-4208-94e0-7ff36c2102a7,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:08:14.045044 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:14.047386 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:08:14.099310 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Routers {'e1d42a7b-c203-472f-94cb-e31f4ffab5c6'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:14.099942 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:07:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:14.104431 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c552149c-8a7f-4f1a-b363-8aff5b00d6b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:14.107275 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c552149c-8a7f-4f1a-b363-8aff5b00d6b1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:14.112226 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-c552149c-8a7f-4f1a-b363-8aff5b00d6b1 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/fd408f56-a193-4323-8cea-02fd6b22bbe9 HTTP/1.1" status: 204 len: 168 time: 0.3696268 Aug 24 03:08:14.148458 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c552149c-8a7f-4f1a-b363-8aff5b00d6b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd408f56-a193-4323-8cea-02fd6b22bbe9,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:14.166656 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8ac8ceee-3d74-476a-8a33-c7b653f92f04 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3523558', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25854779'] for subnet, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:14.171281 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-406408b2-fd44-4037-b327-37f2e58f952a None None] Pushing event updated for resources: {'Port': ['ID=ed6e0056-5b12-4208-94e0-7ff36c2102a7,revision_number=4']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:14.195429 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:08:14.206962 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc77459d-3176-4506-b8ed-faba622a6131 None None] Sync routers for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:08:14.228109 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc77459d-3176-4506-b8ed-faba622a6131 None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:14.229957 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-bc77459d-3176-4506-b8ed-faba622a6131 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:07:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:14.250849 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac8ceee-3d74-476a-8a33-c7b653f92f04 admin admin] Pushing event updated for resources: {'Subnet': ['ID=10284de2-ec04-40b4-850a-d25681a9249e,revision_number=0']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:14.256392 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ac8ceee-3d74-476a-8a33-c7b653f92f04 admin admin] Checking segment: {'id': '4008e385-fd85-46e6-ae27-b19d14c888fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:08:14.256748 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ac8ceee-3d74-476a-8a33-c7b653f92f04 admin admin] Network hostable DHCP agents. Network: 0ea0c802-0090-450d-babb-4d8c5dbdbc8f, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111276) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:08:14.261488 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] Set router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:14.299135 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:14.337063 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-096425a0-2f5d-4ea0-b9ea-f9ae588501f9 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5508990 Aug 24 03:08:14.337871 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'tag': '4137bd43-5447-4d24-a225-3161bde7b9ac'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:08:14.341234 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf259019-5a12-44a0-a4c6-d74d95eb2c1d" -d '{"events": [{"name": "network-changed", "server_uuid": "67b5653d-53be-4bd6-a58f-f8278215abe8", "tag": "4137bd43-5447-4d24-a225-3161bde7b9ac"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:08:14.366971 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-bc77459d-3176-4506-b8ed-faba622a6131 None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:14.386152 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:08:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e4f582a-a13b-4a42-ac32-c779d906b84d x-openstack-request-id: req-8e4f582a-a13b-4a42-ac32-c779d906b84d {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:08:14.386444 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "67b5653d-53be-4bd6-a58f-f8278215abe8", "tag": "4137bd43-5447-4d24-a225-3161bde7b9ac", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:08:14.386691 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-8e4f582a-a13b-4a42-ac32-c779d906b84d {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:08:14.387079 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'tag': '4137bd43-5447-4d24-a225-3161bde7b9ac', 'status': 'completed', 'code': 200} Aug 24 03:08:14.435518 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ac8ceee-3d74-476a-8a33-c7b653f92f04 admin admin] Network 0ea0c802-0090-450d-babb-4d8c5dbdbc8f is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111276) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:08:14.458611 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf259019-5a12-44a0-a4c6-d74d95eb2c1d req-def40850-dc9a-44c5-9934-f35c961b29ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:14.460302 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cf259019-5a12-44a0-a4c6-d74d95eb2c1d req-def40850-dc9a-44c5-9934-f35c961b29ee service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 1098 time: 0.0504925 Aug 24 03:08:14.497446 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 4, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'ed6e0056-5b12-4208-94e0-7ff36c2102a7', 'name': '', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'mac_address': 'fa:16:3e:97:c7:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_interface', 'standard_attr_id': 641, 'fixed_ips': [{'subnet_id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:10Z', 'updated_at': '2021-08-24T03:08:13Z', 'revision_number': 4, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'subnets': [{'id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:14.529037 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06dbb9bc-2f8c-4bd4-8f77-6d8c432681df None None] The sync data for ids ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'] in dv-cinder-803748-8-iscsi is: [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 4, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'ed6e0056-5b12-4208-94e0-7ff36c2102a7', 'name': '', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'mac_address': 'fa:16:3e:97:c7:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_interface', 'standard_attr_id': 641, 'fixed_ips': [{'subnet_id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:10Z', 'updated_at': '2021-08-24T03:08:13Z', 'revision_number': 4, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'subnets': [{'id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:08:14.579494 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [None req-8ac8ceee-3d74-476a-8a33-c7b653f92f04 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, 0ea0c802-0090-450d-babb-4d8c5dbdbc8f) {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:14.603982 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ac8ceee-3d74-476a-8a33-c7b653f92f04 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:14.604646 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8ac8ceee-3d74-476a-8a33-c7b653f92f04 admin admin] Notify callbacks [] for subnet, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:14.613038 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6554efe-1bfb-4126-958f-e89f1f6dbbe9 None None] Network 0ea0c802-0090-450d-babb-4d8c5dbdbc8f requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:08:14.613508 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf259019-5a12-44a0-a4c6-d74d95eb2c1d req-504d2c76-5b99-48d8-bbc2-4df6f917c4e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:14.616634 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cf259019-5a12-44a0-a4c6-d74d95eb2c1d req-504d2c76-5b99-48d8-bbc2-4df6f917c4e6 service neutron] 10.222.0.43 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 913 time: 0.1478760 Aug 24 03:08:14.705265 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cf259019-5a12-44a0-a4c6-d74d95eb2c1d req-e19a510d-19ec-4d48-a1f8-0cf5117f2097 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=4137bd43-5447-4d24-a225-3161bde7b9ac HTTP/1.1" status: 200 len: 999 time: 0.0815880 Aug 24 03:08:14.706672 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-8ac8ceee-3d74-476a-8a33-c7b653f92f04 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.9513714 Aug 24 03:08:14.710144 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41226) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:14.716423 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-349617832-router', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:14.726597 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-bc77459d-3176-4506-b8ed-faba622a6131 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'bb5fca44-f88d-40fe-b3a8-a36920d12ada', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.136', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 507, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:af:19:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b446c10-d1d6-4e68-959c-417655d2070b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:06:00Z', 'updated_at': '2021-08-24T03:06:03Z', 'revision_number': 1, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}, {'id': 'dac795f4-6bda-4417-aa85-44e7c2f1e1b4', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.131', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': '4137bd43-5447-4d24-a225-3161bde7b9ac', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 643, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:24:56:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:08:12Z', 'updated_at': '2021-08-24T03:08:12Z', 'revision_number': 0, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:14.763417 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc77459d-3176-4506-b8ed-faba622a6131 None None] Checking router: 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:08:14.783955 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf259019-5a12-44a0-a4c6-d74d95eb2c1d req-4b5666c1-2d16-405a-a2b1-69699ee43653 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:14.784912 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cf259019-5a12-44a0-a4c6-d74d95eb2c1d req-4b5666c1-2d16-405a-a2b1-69699ee43653 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 200 len: 851 time: 0.0632064 Aug 24 03:08:14.797545 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc77459d-3176-4506-b8ed-faba622a6131 None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:14.798205 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-bc77459d-3176-4506-b8ed-faba622a6131 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:07:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:14.827376 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-560365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32717'] for router, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:14.828543 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-560249', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-569518', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-437890', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32692'] for router, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:14.871463 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf259019-5a12-44a0-a4c6-d74d95eb2c1d req-a069819d-5387-4fd0-ba17-8418242da073 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:14.873512 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cf259019-5a12-44a0-a4c6-d74d95eb2c1d req-a069819d-5387-4fd0-ba17-8418242da073 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0819225 Aug 24 03:08:14.909754 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpc8ebca0a-8efd-5c96-8278-1a4ec08c6f82-0ea0c802-0090-450d-babb-4d8c5dbdbc8f', 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'fixed_ips': [{'subnet_id': '10284de2-ec04-40b4-850a-d25681a9249e'}]}} from dv-cinder-803748-8-iscsi. {{(pid=111277) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Aug 24 03:08:14.911238 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:14.912937 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:14.956222 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-bc77459d-3176-4506-b8ed-faba622a6131 None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:14.980431 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cf259019-5a12-44a0-a4c6-d74d95eb2c1d req-ecf1105a-3a96-413d-8b8c-8b2d610e82a2 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0991271 Aug 24 03:08:15.121039 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-cf259019-5a12-44a0-a4c6-d74d95eb2c1d req-ad8844cc-01a1-4622-b7b3-7622a8ce5849 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1272128 Aug 24 03:08:15.188545 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.db_base_plugin_common [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Allocated IP 172.20.0.2 (0ea0c802-0090-450d-babb-4d8c5dbdbc8f/10284de2-ec04-40b4-850a-d25681a9249e/a2847c01-6cbd-41f7-a408-51b5059780df) {{(pid=111277) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:08:15.195803 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.207839 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41228) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:15.231602 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c914e0f4-ecbe-4d29-be7d-8028c589bfdd admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.335734 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:15.362470 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c914e0f4-ecbe-4d29-be7d-8028c589bfdd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.450496 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-c914e0f4-ecbe-4d29-be7d-8028c589bfdd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.485657 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:15.486041 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.489092 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Notify callbacks [] for port, precommit_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.499456 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-c914e0f4-ecbe-4d29-be7d-8028c589bfdd admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ee9f33c502ed4308912aa9e4a37d0ca8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2896867 Aug 24 03:08:15.503868 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41230) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:15.513208 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-bc77459d-3176-4506-b8ed-faba622a6131 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'bb5fca44-f88d-40fe-b3a8-a36920d12ada', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.136', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 507, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:af:19:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b446c10-d1d6-4e68-959c-417655d2070b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:06:00Z', 'updated_at': '2021-08-24T03:06:03Z', 'revision_number': 1, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}, {'id': 'dac795f4-6bda-4417-aa85-44e7c2f1e1b4', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.131', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': '4137bd43-5447-4d24-a225-3161bde7b9ac', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 643, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:24:56:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:08:12Z', 'updated_at': '2021-08-24T03:08:12Z', 'revision_number': 0, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:15.520267 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c914e0f4-ecbe-4d29-be7d-8028c589bfdd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=161c91da-8773-4ec2-a098-6d9f50f2176c,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:15.548370 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Transition to ACTIVE for port object a2847c01-6cbd-41f7-a408-51b5059780df will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:15.554472 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc77459d-3176-4506-b8ed-faba622a6131 None None] The sync data for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi is: [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'bb5fca44-f88d-40fe-b3a8-a36920d12ada', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.136', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 507, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:af:19:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b446c10-d1d6-4e68-959c-417655d2070b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:06:00Z', 'updated_at': '2021-08-24T03:06:03Z', 'revision_number': 1, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}, {'id': 'dac795f4-6bda-4417-aa85-44e7c2f1e1b4', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.131', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': '4137bd43-5447-4d24-a225-3161bde7b9ac', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 643, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:24:56:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:08:12Z', 'updated_at': '2021-08-24T03:08:12Z', 'revision_number': 0, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:08:15.567614 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.570600 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8d18ff59-2fcd-44a8-a531-6f67bb390106 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.580485 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Transition to ACTIVE for port object a2847c01-6cbd-41f7-a408-51b5059780df will not be triggered until provisioned by entity DHCP. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:15.590387 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.597109 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8d18ff59-2fcd-44a8-a531-6f67bb390106 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.662715 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device ed6e0056-5b12-4208-94e0-7ff36c2102a7 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:15.687613 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045'] for port, after_create {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.731205 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8d18ff59-2fcd-44a8-a531-6f67bb390106 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.736180 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8d18ff59-2fcd-44a8-a531-6f67bb390106 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.738309 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-8d18ff59-2fcd-44a8-a531-6f67bb390106 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/161c91da-8773-4ec2-a098-6d9f50f2176c HTTP/1.1" status: 204 len: 168 time: 0.2322061 Aug 24 03:08:15.745887 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Network 0ea0c802-0090-450d-babb-4d8c5dbdbc8f is already hosted by enough agents. {{(pid=111277) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:08:15.759101 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.scheduler.base_scheduler [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Resources bound (agent type, host, resource id): {{(pid=111277) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:15.761485 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Allocated IP 172.27.2.121 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/35e488a7-bf51-48e0-a230-0481006d2fbb) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:08:15.762452 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Received port after_create {{(pid=111277) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:08:15.768284 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Pushing event updated for resources: {'Port': ['ID=a2847c01-6cbd-41f7-a408-51b5059780df,revision_number=1']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:15.770721 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d18ff59-2fcd-44a8-a531-6f67bb390106 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=161c91da-8773-4ec2-a098-6d9f50f2176c,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:15.865279 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Attempting to bind port a2847c01-6cbd-41f7-a408-51b5059780df on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:08:15.865706 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Attempting to bind port a2847c01-6cbd-41f7-a408-51b5059780df by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '4008e385-fd85-46e6-ae27-b19d14c888fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:08:15.866070 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Attempting to bind port a2847c01-6cbd-41f7-a408-51b5059780df on network 0ea0c802-0090-450d-babb-4d8c5dbdbc8f {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:08:15.873692 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 7, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:08:15.874748 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Checking segment: {'id': '4008e385-fd85-46e6-ae27-b19d14c888fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:08:15.874748 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.875041 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Bound using segment: {'id': '4008e385-fd85-46e6-ae27-b19d14c888fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:08:15.875511 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Bound port: a2847c01-6cbd-41f7-a408-51b5059780df, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4008e385-fd85-46e6-ae27-b19d14c888fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:08:15.875893 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:15.894006 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c22ac0e9-6194-4d2d-9b61-e7e14325f6e4 None None] New status for floating IP dac795f4-6bda-4417-aa85-44e7c2f1e1b4: ACTIVE {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:08:15.925268 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:16.061712 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port ed6e0056-5b12-4208-94e0-7ff36c2102a7 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:16.069414 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port ed6e0056-5b12-4208-94e0-7ff36c2102a7 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:16.069821 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:16.090780 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:16.124553 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] For port a2847c01-6cbd-41f7-a408-51b5059780df, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:08:16.132308 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:08:16.135506 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:16.138352 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:08:16.138767 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] For port a2847c01-6cbd-41f7-a408-51b5059780df, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=a2847c01-6cbd-41f7-a408-51b5059780df,segment=NetworkSegment(4008e385-fd85-46e6-ae27-b19d14c888fd),segment_id=4008e385-fd85-46e6-ae27-b19d14c888fd)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:08:16.172866 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Pushing event updated for resources: {'Port': ['ID=35e488a7-bf51-48e0-a230-0481006d2fbb,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:16.181868 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:16.232239 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port ed6e0056-5b12-4208-94e0-7ff36c2102a7, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=ed6e0056-5b12-4208-94e0-7ff36c2102a7,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:16.234815 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:16.295020 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4cfa881-01b8-4c61-a33f-73a0db44c5c8 None None] Pushing event updated for resources: {'Port': ['ID=a2847c01-6cbd-41f7-a408-51b5059780df,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:16.371776 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:16.420041 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=ed6e0056-5b12-4208-94e0-7ff36c2102a7,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:16.558020 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:16.692530 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41236) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:16.709022 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-46090f7d-f678-409d-b516-eb10295a28a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:16.757076 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-560242', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-569595'] for router, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:16.800746 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-46090f7d-f678-409d-b516-eb10295a28a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:16.863717 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-46090f7d-f678-409d-b516-eb10295a28a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:16.906409 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-46090f7d-f678-409d-b516-eb10295a28a6 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=11fedca5e65d4de6b0c5159407e1e78e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2133708 Aug 24 03:08:16.907121 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46090f7d-f678-409d-b516-eb10295a28a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ee3a5bfd-299b-451f-9eb4-2710e2ffe027,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:16.909246 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41238) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:16.960848 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Router b0ea82a6-cb14-437b-9500-710e02bccb2c is scheduled to L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 with binding_index 1 {{(pid=111275) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Aug 24 03:08:16.970842 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4f681640-aaa2-47f9-97a3-ab5858b5d03e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:17.029137 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4f681640-aaa2-47f9-97a3-ab5858b5d03e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:17.115711 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:08:17.128312 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Sync routers for ids ['b0ea82a6-cb14-437b-9500-710e02bccb2c'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:08:17.143181 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Routers {'b0ea82a6-cb14-437b-9500-710e02bccb2c'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:17.143822 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:07:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['b0ea82a6-cb14-437b-9500-710e02bccb2c'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:17.189406 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4f681640-aaa2-47f9-97a3-ab5858b5d03e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:17.192321 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-4f681640-aaa2-47f9-97a3-ab5858b5d03e admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:17.196940 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-4f681640-aaa2-47f9-97a3-ab5858b5d03e admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ee3a5bfd-299b-451f-9eb4-2710e2ffe027 HTTP/1.1" status: 204 len: 168 time: 0.2833366 Aug 24 03:08:17.207150 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f681640-aaa2-47f9-97a3-ab5858b5d03e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee3a5bfd-299b-451f-9eb4-2710e2ffe027,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:17.216139 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] Notify callbacks [] for router, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:17.218411 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-20a4576c-7d94-48f2-93f3-96b72a5209ec admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.5071635 Aug 24 03:08:17.221072 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41242) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:17.264301 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6395a9a-3b8c-4ef7-b40d-f8eb56d30b32 None None] Network 0ea0c802-0090-450d-babb-4d8c5dbdbc8f requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:08:17.329298 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device a2847c01-6cbd-41f7-a408-51b5059780df up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:17.343835 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Set router b0ea82a6-cb14-437b-9500-710e02bccb2c gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:17.517289 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-51d795f4-f94b-4112-bf3f-c75d56c7a0ae None None] Provisioning for port a2847c01-6cbd-41f7-a408-51b5059780df completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:17.650697 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port a2847c01-6cbd-41f7-a408-51b5059780df completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:17.654940 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port a2847c01-6cbd-41f7-a408-51b5059780df triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:17.655316 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:17.714088 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'name': 'tempest-TestMinimumBasicScenario-349617832-router', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121'}], 'enable_snat': True}, 'gw_port_id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:14Z', 'updated_at': '2021-08-24T03:08:16Z', 'revision_number': 3, 'project_id': '849103eb110a4cd69c63067564c4696e', 'gw_port': {'id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:54:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:15Z', 'updated_at': '2021-08-24T03:08:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:17.744519 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Checking router: b0ea82a6-cb14-437b-9500-710e02bccb2c for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:08:17.744862 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Updating router b0ea82a6-cb14-437b-9500-710e02bccb2c port 35e488a7-bf51-48e0-a230-0481006d2fbb binding host dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:08:17.795506 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:17.826146 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:17.929784 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port a2847c01-6cbd-41f7-a408-51b5059780df, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=a2847c01-6cbd-41f7-a408-51b5059780df,segment=NetworkSegment(4008e385-fd85-46e6-ae27-b19d14c888fd),segment_id=4008e385-fd85-46e6-ae27-b19d14c888fd)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:17.974561 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:17.990945 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-69a59c84-1035-4c92-b74a-73f5b4d23ab2 None None] Provisioning complete for port a2847c01-6cbd-41f7-a408-51b5059780df triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:17.991330 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-69a59c84-1035-4c92-b74a-73f5b4d23ab2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.016083 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.016861 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device ed6e0056-5b12-4208-94e0-7ff36c2102a7 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:18.144704 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Allocated IP 172.20.0.1 (0ea0c802-0090-450d-babb-4d8c5dbdbc8f/10284de2-ec04-40b4-850a-d25681a9249e/acbc4b29-2d6f-4171-ac20-407f3fef3906) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:08:18.160306 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=a2847c01-6cbd-41f7-a408-51b5059780df,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:18.231233 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port ed6e0056-5b12-4208-94e0-7ff36c2102a7 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:18.231528 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.256833 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.272574 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.provisioning_blocks [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Transition to ACTIVE for port object acbc4b29-2d6f-4171-ac20-407f3fef3906 will not be triggered until provisioned by entity DHCP. {{(pid=111275) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:18.281035 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Notify callbacks [] for port, precommit_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.296904 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Transition to ACTIVE for port object 35e488a7-bf51-48e0-a230-0481006d2fbb will not be triggered until provisioned by entity L2. {{(pid=111277) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:18.370057 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.395609 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.423755 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Attempting to bind port 35e488a7-bf51-48e0-a230-0481006d2fbb on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:08:18.423755 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Attempting to bind port 35e488a7-bf51-48e0-a230-0481006d2fbb by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:08:18.423755 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Attempting to bind port 35e488a7-bf51-48e0-a230-0481006d2fbb on network 63097abe-4b2c-457b-a244-629c1feb1fe5 {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:08:18.425917 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e739a05-c4fb-4258-a786-810b53aabfa1 None None] Pushing event updated for resources: {'Port': ['ID=35e488a7-bf51-48e0-a230-0481006d2fbb,revision_number=2']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:18.431327 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 7, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:08:18.432113 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Checking segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111277) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:08:18.432113 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.432563 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Bound using segment: {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'} {{(pid=111277) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:08:18.432947 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.managers [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Bound port: 35e488a7-bf51-48e0-a230-0481006d2fbb, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '14cb234e-5636-4a14-a6ad-467857ff59ba', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5'}}] {{(pid=111277) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:08:18.433330 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.440007 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Network 0ea0c802-0090-450d-babb-4d8c5dbdbc8f is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:08:18.442890 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:18.447108 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:08:18.476426 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Pushing event updated for resources: {'Port': ['ID=acbc4b29-2d6f-4171-ac20-407f3fef3906,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:18.500131 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-571748'] for router_interface, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.500704 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] For port 35e488a7-bf51-48e0-a230-0481006d2fbb, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111277) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:08:18.507584 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] For port 35e488a7-bf51-48e0-a230-0481006d2fbb, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=35e488a7-bf51-48e0-a230-0481006d2fbb,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:08:18.589862 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.648211 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Routers {'b0ea82a6-cb14-437b-9500-710e02bccb2c'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:18.648879 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:07:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['b0ea82a6-cb14-437b-9500-710e02bccb2c'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:18.701401 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e739a05-c4fb-4258-a786-810b53aabfa1 None None] Pushing event updated for resources: {'Port': ['ID=35e488a7-bf51-48e0-a230-0481006d2fbb,revision_number=3']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:18.722998 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.876417 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-712a50a8-9dbd-436e-a326-d7439c088338 None None] Provisioning for port acbc4b29-2d6f-4171-ac20-407f3fef3906 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:18.884557 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-712a50a8-9dbd-436e-a326-d7439c088338 None None] Provisioning complete for port acbc4b29-2d6f-4171-ac20-407f3fef3906 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:18.884942 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-712a50a8-9dbd-436e-a326-d7439c088338 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.898406 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Notify callbacks [] for port, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:18.932455 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] Set router b0ea82a6-cb14-437b-9500-710e02bccb2c gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:18.961839 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-712a50a8-9dbd-436e-a326-d7439c088338 None None] Port acbc4b29-2d6f-4171-ac20-407f3fef3906 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:08:18.972601 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3484283'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:19.049728 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-748278', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-571822'] for router_interface, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:19.051423 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Pushing event updated for resources: {'Port': ['ID=acbc4b29-2d6f-4171-ac20-407f3fef3906,revision_number=2']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:19.128452 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'name': 'tempest-TestMinimumBasicScenario-349617832-router', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121'}], 'enable_snat': True}, 'gw_port_id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:14Z', 'updated_at': '2021-08-24T03:08:16Z', 'revision_number': 3, 'project_id': '849103eb110a4cd69c63067564c4696e', 'gw_port': {'id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:54:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:15Z', 'updated_at': '2021-08-24T03:08:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:19.148851 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Network 0ea0c802-0090-450d-babb-4d8c5dbdbc8f is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:08:19.150530 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:19.183666 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acb9beba-7ff3-4fc7-ac3a-c0124737b446 None None] The sync data for ids ['b0ea82a6-cb14-437b-9500-710e02bccb2c'] in dv-cinder-803748-8-iscsi is: [{'id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'name': 'tempest-TestMinimumBasicScenario-349617832-router', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121'}], 'enable_snat': True}, 'gw_port_id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:14Z', 'updated_at': '2021-08-24T03:08:16Z', 'revision_number': 3, 'project_id': '849103eb110a4cd69c63067564c4696e', 'gw_port': {'id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:54:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:15Z', 'updated_at': '2021-08-24T03:08:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:08:19.192884 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device a2847c01-6cbd-41f7-a408-51b5059780df up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:19.266103 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port a2847c01-6cbd-41f7-a408-51b5059780df triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:19.266478 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:19.299136 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Router b0ea82a6-cb14-437b-9500-710e02bccb2c has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:08:19.433354 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:08:19.440375 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-dbb3bbd2-83ad-4894-803b-a67edf752153 admin admin] 10.222.0.30 "PUT /v2.0/routers/b0ea82a6-cb14-437b-9500-710e02bccb2c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2165182 Aug 24 03:08:19.488973 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-1101403a-6299-4894-ad45-004ad5f8acd8 None None] Provisioning complete for port acbc4b29-2d6f-4171-ac20-407f3fef3906 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:19.489563 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-1101403a-6299-4894-ad45-004ad5f8acd8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:19.532032 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-1101403a-6299-4894-ad45-004ad5f8acd8 None None] Port acbc4b29-2d6f-4171-ac20-407f3fef3906 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:08:20.566525 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:08:21.212369 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 35e488a7-bf51-48e0-a230-0481006d2fbb up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:21.326391 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port 35e488a7-bf51-48e0-a230-0481006d2fbb completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:21.330520 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 35e488a7-bf51-48e0-a230-0481006d2fbb triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:21.330983 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:21.378242 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-60126b55-5d5e-47b1-8a92-1aa95fdc8d99 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:21.426235 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:21.450941 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port 35e488a7-bf51-48e0-a230-0481006d2fbb, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=35e488a7-bf51-48e0-a230-0481006d2fbb,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:21.520598 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:21.584350 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=35e488a7-bf51-48e0-a230-0481006d2fbb,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:22.662027 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Sync routers for ids ['b0ea82a6-cb14-437b-9500-710e02bccb2c'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:08:22.672616 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Routers {'b0ea82a6-cb14-437b-9500-710e02bccb2c'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:22.673401 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:07:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['b0ea82a6-cb14-437b-9500-710e02bccb2c'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:22.787698 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Set router b0ea82a6-cb14-437b-9500-710e02bccb2c gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:22.994095 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'name': 'tempest-TestMinimumBasicScenario-349617832-router', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121'}], 'enable_snat': True}, 'gw_port_id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:14Z', 'updated_at': '2021-08-24T03:08:18Z', 'revision_number': 4, 'project_id': '849103eb110a4cd69c63067564c4696e', 'gw_port': {'id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:54:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:15Z', 'updated_at': '2021-08-24T03:08:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'acbc4b29-2d6f-4171-ac20-407f3fef3906', 'name': '', 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'mac_address': 'fa:16:3e:6d:ad:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '10284de2-ec04-40b4-850a-d25681a9249e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:17Z', 'updated_at': '2021-08-24T03:08:18Z', 'revision_number': 2, 'project_id': '849103eb110a4cd69c63067564c4696e', 'subnets': [{'id': '10284de2-ec04-40b4-850a-d25681a9249e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:23.023947 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Checking router: b0ea82a6-cb14-437b-9500-710e02bccb2c for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:08:23.024299 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Updating router b0ea82a6-cb14-437b-9500-710e02bccb2c port acbc4b29-2d6f-4171-ac20-407f3fef3906 binding host dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Aug 24 03:08:23.050186 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:23.182100 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 35e488a7-bf51-48e0-a230-0481006d2fbb up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:23.229225 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port 35e488a7-bf51-48e0-a230-0481006d2fbb triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:23.229618 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:23.330101 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Notify callbacks [] for port, precommit_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:23.339763 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.provisioning_blocks [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Transition to ACTIVE for port object acbc4b29-2d6f-4171-ac20-407f3fef3906 will not be triggered until provisioned by entity L2. {{(pid=111278) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:23.440709 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:23.486014 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54757080-3ec8-4d00-b073-04a842c7e53e None None] Pushing event updated for resources: {'Port': ['ID=acbc4b29-2d6f-4171-ac20-407f3fef3906,revision_number=3']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:23.554912 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Attempting to bind port acbc4b29-2d6f-4171-ac20-407f3fef3906 on host dv-cinder-803748-8-iscsi for vnic_type normal with profile {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:08:23.555278 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Attempting to bind port acbc4b29-2d6f-4171-ac20-407f3fef3906 by drivers openvswitch,hyperv on host dv-cinder-803748-8-iscsi at level 0 using segments [{'id': '4008e385-fd85-46e6-ae27-b19d14c888fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f'}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:08:23.555640 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Attempting to bind port acbc4b29-2d6f-4171-ac20-407f3fef3906 on network 0ea0c802-0090-450d-babb-4d8c5dbdbc8f {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:08:23.560848 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Checking agent: {'id': 'f64a35e0-29e9-4c28-966a-fcb09a8717a5', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-803748-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 51, 24), 'started_at': datetime.datetime(2021, 8, 24, 2, 51, 54), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 7, 54), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-803748-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:08:23.561219 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Checking segment: {'id': '4008e385-fd85-46e6-ae27-b19d14c888fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111278) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:08:23.561682 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:23.562194 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Bound using segment: {'id': '4008e385-fd85-46e6-ae27-b19d14c888fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f'} {{(pid=111278) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:08:23.562656 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.managers [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Bound port: acbc4b29-2d6f-4171-ac20-407f3fef3906, host: dv-cinder-803748-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4008e385-fd85-46e6-ae27-b19d14c888fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f'}}] {{(pid=111278) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:08:23.563052 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:23.630705 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] For port acbc4b29-2d6f-4171-ac20-407f3fef3906, host dv-cinder-803748-8-iscsi, cleared binding levels {{(pid=111278) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:08:23.634638 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.plugins.ml2.db [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] For port acbc4b29-2d6f-4171-ac20-407f3fef3906, host dv-cinder-803748-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=acbc4b29-2d6f-4171-ac20-407f3fef3906,segment=NetworkSegment(4008e385-fd85-46e6-ae27-b19d14c888fd),segment_id=4008e385-fd85-46e6-ae27-b19d14c888fd)] {{(pid=111278) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:08:23.701624 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron_lib.callbacks.manager [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111278) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:23.759722 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54757080-3ec8-4d00-b073-04a842c7e53e None None] Pushing event updated for resources: {'Port': ['ID=acbc4b29-2d6f-4171-ac20-407f3fef3906,revision_number=4']} {{(pid=111278) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:23.775999 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Routers {'b0ea82a6-cb14-437b-9500-710e02bccb2c'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:23.776524 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:07:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['b0ea82a6-cb14-437b-9500-710e02bccb2c'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:23.978789 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-7d7f006c-a120-4dda-b16d-91034e81b9dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:24.013064 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] Set router b0ea82a6-cb14-437b-9500-710e02bccb2c gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:24.234888 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'name': 'tempest-TestMinimumBasicScenario-349617832-router', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121'}], 'enable_snat': True}, 'gw_port_id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:14Z', 'updated_at': '2021-08-24T03:08:18Z', 'revision_number': 4, 'project_id': '849103eb110a4cd69c63067564c4696e', 'gw_port': {'id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:54:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:15Z', 'updated_at': '2021-08-24T03:08:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'acbc4b29-2d6f-4171-ac20-407f3fef3906', 'name': '', 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'mac_address': 'fa:16:3e:6d:ad:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '10284de2-ec04-40b4-850a-d25681a9249e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:17Z', 'updated_at': '2021-08-24T03:08:23Z', 'revision_number': 4, 'project_id': '849103eb110a4cd69c63067564c4696e', 'subnets': [{'id': '10284de2-ec04-40b4-850a-d25681a9249e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:24.270571 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ede88f11-e5cf-468e-bea3-12748ecca046 None None] The sync data for ids ['b0ea82a6-cb14-437b-9500-710e02bccb2c'] in dv-cinder-803748-8-iscsi is: [{'id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'name': 'tempest-TestMinimumBasicScenario-349617832-router', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121'}], 'enable_snat': True}, 'gw_port_id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:14Z', 'updated_at': '2021-08-24T03:08:18Z', 'revision_number': 4, 'project_id': '849103eb110a4cd69c63067564c4696e', 'gw_port': {'id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:54:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:15Z', 'updated_at': '2021-08-24T03:08:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'acbc4b29-2d6f-4171-ac20-407f3fef3906', 'name': '', 'network_id': '0ea0c802-0090-450d-babb-4d8c5dbdbc8f', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'mac_address': 'fa:16:3e:6d:ad:73', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'device_owner': 'network:router_interface', 'standard_attr_id': 670, 'fixed_ips': [{'subnet_id': '10284de2-ec04-40b4-850a-d25681a9249e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:17Z', 'updated_at': '2021-08-24T03:08:23Z', 'revision_number': 4, 'project_id': '849103eb110a4cd69c63067564c4696e', 'subnets': [{'id': '10284de2-ec04-40b4-850a-d25681a9249e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:08:24.341632 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:25.233514 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device acbc4b29-2d6f-4171-ac20-407f3fef3906 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:25.395422 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning for port acbc4b29-2d6f-4171-ac20-407f3fef3906 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:25.407706 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port acbc4b29-2d6f-4171-ac20-407f3fef3906 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:25.407706 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:25.519881 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:25.581512 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] For port acbc4b29-2d6f-4171-ac20-407f3fef3906, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=acbc4b29-2d6f-4171-ac20-407f3fef3906,segment=NetworkSegment(4008e385-fd85-46e6-ae27-b19d14c888fd),segment_id=4008e385-fd85-46e6-ae27-b19d14c888fd)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:25.604017 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:25.695955 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:25.750894 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Pushing event updated for resources: {'Port': ['ID=acbc4b29-2d6f-4171-ac20-407f3fef3906,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:26.978434 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:27.178852 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device acbc4b29-2d6f-4171-ac20-407f3fef3906 up at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:27.232664 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Provisioning complete for port acbc4b29-2d6f-4171-ac20-407f3fef3906 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:27.233367 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:31.319118 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-c6d8be09-2245-4510-a2fc-a33158cbde88 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:31.320570 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-c6d8be09-2245-4510-a2fc-a33158cbde88 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/networks?id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b HTTP/1.1" status: 200 len: 815 time: 0.0991399 Aug 24 03:08:31.335048 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-c27c36d3-49f3-450d-82e9-ed092b25b0d2 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/quotas/a74f1fd1896c4ed09ff280398fa2440f HTTP/1.1" status: 200 len: 375 time: 0.0087259 Aug 24 03:08:31.388932 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-ef719cee-53bc-40da-a748-6823077a238b tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=a74f1fd1896c4ed09ff280398fa2440f&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0487502 Aug 24 03:08:31.482479 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-2f1b8fd4-5e90-4390-9d85-1baf0cdd26ab service neutron] 10.222.0.30 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814688 Aug 24 03:08:31.574100 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-58f01c80-fa73-456e-abc0-e7f96eb602fc service neutron] 10.222.0.30 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856638 Aug 24 03:08:31.809960 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-e4138df2-4285-4685-ac30-e4a47ac77ba7 req-e6389693-bb06-46f9-93a1-4ef987d0c22d tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 210 time: 0.0286164 Aug 24 03:08:32.892207 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8b12cc65-def6-4765-b732-a1caffed3841 req-ab689745-4bfc-4c32-9aef-ddf3e3a9a5ce tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 210 time: 0.0273528 Aug 24 03:08:33.985718 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f75f9739-99b2-493c-8e6a-1d00a56e5b8c req-0fedf67b-c41e-4087-b119-e3ef33fc8925 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 210 time: 0.0274761 Aug 24 03:08:34.596049 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-cc52eda0-1aa7-43b3-8b46-3574ced2d6d4 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:34.597487 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-cc52eda0-1aa7-43b3-8b46-3574ced2d6d4 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.43 "GET /v2.0/networks?id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b HTTP/1.1" status: 200 len: 815 time: 0.1074269 Aug 24 03:08:34.611981 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Request body: {'port': {'device_id': '95e65125-3e9f-477e-93cc-b0762249f60d', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'admin_state_up': True, 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:34.794563 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Made reservation on behalf of a74f1fd1896c4ed09ff280398fa2440f for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:08:34.798132 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:34.928639 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Allocated IP 172.20.0.6 (ae628e21-d19e-4dd7-aa51-fd72f4db7e1b/f42fa902-0e1e-4185-b486-54648ea18f14/c163baa9-83ec-4da5-a79e-088fea86e5c9) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:08:35.080149 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-822bcc52-1170-4f54-afd4-d503f4bfdd86 req-081494c8-fee1-4984-8f4e-93780a125a93 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 210 time: 0.0261240 Aug 24 03:08:35.083713 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:35.099764 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Transition to ACTIVE for port object c163baa9-83ec-4da5-a79e-088fea86e5c9 will not be triggered until provisioned by entity DHCP. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:35.280609 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:35.323297 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:08:35.326251 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:35.329814 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:08:35.356165 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event updated for resources: {'Port': ['ID=c163baa9-83ec-4da5-a79e-088fea86e5c9,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:35.372988 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:35.373337 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:35.373700 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:35.374050 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:35.374379 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:35.374712 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:35.375039 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:35.375366 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:35.375691 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:35.376013 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:35.376351 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:35.376660 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:35.395274 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:35.395896 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:35.507081 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-331cc4db-ad8f-4399-bdbf-e1ad1b2e3c2e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8987114 Aug 24 03:08:35.582659 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-738c1bb0-17ef-45ed-9e84-f7907adbcb72 None None] Provisioning for port c163baa9-83ec-4da5-a79e-088fea86e5c9 completed by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:35.586304 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-738c1bb0-17ef-45ed-9e84-f7907adbcb72 None None] Provisioning complete for port c163baa9-83ec-4da5-a79e-088fea86e5c9 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:35.586732 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-738c1bb0-17ef-45ed-9e84-f7907adbcb72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:35.620500 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-738c1bb0-17ef-45ed-9e84-f7907adbcb72 None None] Port c163baa9-83ec-4da5-a79e-088fea86e5c9 cannot update to ACTIVE because it is not bound. {{(pid=111277) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} Aug 24 03:08:36.195029 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daf80581-8d2c-4db8-926a-2596133eb685 req-ea5d8ce8-4c96-4799-8850-5d7542f57c74 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:36.196307 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-daf80581-8d2c-4db8-926a-2596133eb685 req-ea5d8ce8-4c96-4799-8850-5d7542f57c74 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 931 time: 0.0478737 Aug 24 03:08:36.234403 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-daf80581-8d2c-4db8-926a-2596133eb685 req-48f126ce-f6c5-46c5-991b-7bda3d37eb75 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306952 Aug 24 03:08:36.760906 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Request body: {'port': {'device_id': '95e65125-3e9f-477e-93cc-b0762249f60d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:36.815321 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:37.067656 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c163baa9-83ec-4da5-a79e-088fea86e5c9 {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:08:37.075616 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:37.087846 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Transition to ACTIVE for port object c163baa9-83ec-4da5-a79e-088fea86e5c9 will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:37.163726 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:37.170203 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41414) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:37.251121 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Pushing event updated for resources: {'Port': ['ID=c163baa9-83ec-4da5-a79e-088fea86e5c9,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:37.296613 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Attempting to bind port c163baa9-83ec-4da5-a79e-088fea86e5c9 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:08:37.297045 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Attempting to bind port c163baa9-83ec-4da5-a79e-088fea86e5c9 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:08:37.297493 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Attempting to bind port c163baa9-83ec-4da5-a79e-088fea86e5c9 on network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:08:37.302966 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Port c163baa9-83ec-4da5-a79e-088fea86e5c9 on network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:08:37.303371 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Attempting to bind port c163baa9-83ec-4da5-a79e-088fea86e5c9 on network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:08:37.309378 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 8, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:08:37.309807 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Checking segment: {'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:08:37.310250 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Bound using segment: {'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:08:37.310786 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Bound port: c163baa9-83ec-4da5-a79e-088fea86e5c9, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd71e524b-5651-4545-b1cf-eda4cfb942c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:08:37.311226 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:37.377460 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43200471-82a7-4136-9c6f-323be991f55e req-6124bb0b-fb66-418f-8691-9e3983b687f4 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:37.379003 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-43200471-82a7-4136-9c6f-323be991f55e req-6124bb0b-fb66-418f-8691-9e3983b687f4 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.0603783 Aug 24 03:08:37.382821 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] For port c163baa9-83ec-4da5-a79e-088fea86e5c9, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:08:37.386407 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] For port c163baa9-83ec-4da5-a79e-088fea86e5c9, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:08:37.388508 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Deleting port 1b32c3bd-bd0a-4c78-92f0-3137d18bd870 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:08:37.388856 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:37.452166 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:37.466631 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-43200471-82a7-4136-9c6f-323be991f55e req-60693331-d3f0-4904-b180-aab54080819d tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0803320 Aug 24 03:08:37.487570 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:37.488183 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:37.489644 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] 10.222.0.43 "PUT /v2.0/ports/c163baa9-83ec-4da5-a79e-088fea86e5c9 HTTP/1.1" status: 200 len: 1093 time: 0.7332172 Aug 24 03:08:37.490088 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:08:37.492192 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:37.492389 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ed3e525d-94b7-4847-9fb9-4fce8c020186" -d '{"events": [{"name": "network-changed", "server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:08:37.492511 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:37.505840 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Calling delete_port for 1b32c3bd-bd0a-4c78-92f0-3137d18bd870 owned by network:floatingip {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:08:37.522633 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bba69e0c-95d9-47e4-859d-9256ad698ae3 service neutron] Pushing event updated for resources: {'Port': ['ID=c163baa9-83ec-4da5-a79e-088fea86e5c9,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:37.541408 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:08:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f674fd0d-efaf-4894-853d-b31138e36b3d x-openstack-request-id: req-f674fd0d-efaf-4894-853d-b31138e36b3d {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:08:37.541766 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:08:37.542019 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f674fd0d-efaf-4894-853d-b31138e36b3d {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:08:37.542427 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'status': 'completed', 'code': 200} Aug 24 03:08:37.746504 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:37.769193 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed3e525d-94b7-4847-9fb9-4fce8c020186 req-04b539c7-154f-4d1c-ac3f-f7431499d622 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:37.771305 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ed3e525d-94b7-4847-9fb9-4fce8c020186 req-04b539c7-154f-4d1c-ac3f-f7431499d622 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=a74f1fd1896c4ed09ff280398fa2440f&device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 1096 time: 0.0478404 Aug 24 03:08:37.781010 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event deleted for resources: {'Port': ['ID=1b32c3bd-bd0a-4c78-92f0-3137d18bd870,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:37.838076 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for floatingip, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:37.839320 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.l3_db [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Floating IP 81fab793-8623-49ae-8bb9-30e9de6c0937 disassociated (deleted). External IP: 172.27.2.112, port: 8069cbc1-7d07-44d4-b500-7a5a4c751d09. Aug 24 03:08:37.876766 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed3e525d-94b7-4847-9fb9-4fce8c020186 req-3707235e-2cf5-418c-af3b-51bb882fa8f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:37.878112 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ed3e525d-94b7-4847-9fb9-4fce8c020186 req-3707235e-2cf5-418c-af3b-51bb882fa8f5 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=a74f1fd1896c4ed09ff280398fa2440f&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0979474 Aug 24 03:08:37.978486 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed3e525d-94b7-4847-9fb9-4fce8c020186 req-21d4944b-a5f3-4cd7-a3e0-47959f792ff5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:37.979901 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ed3e525d-94b7-4847-9fb9-4fce8c020186 req-21d4944b-a5f3-4cd7-a3e0-47959f792ff5 service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0937550 Aug 24 03:08:38.085417 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-d6910e25-98cc-4618-ace5-6ff930eb73d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:38.085813 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Router 237f95eb-7035-4674-99ff-35e2f14fc035 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:08:38.088267 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-d6910e25-98cc-4618-ace5-6ff930eb73d0 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=a74f1fd1896c4ed09ff280398fa2440f&device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 1096 time: 0.0608556 Aug 24 03:08:38.224592 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:08:38.230808 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:38.238842 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-730f138c-4473-4632-9050-92f2f83f7bf2 None None] Sync routers for ids ['237f95eb-7035-4674-99ff-35e2f14fc035'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:08:38.253718 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-730f138c-4473-4632-9050-92f2f83f7bf2 None None] Routers {'237f95eb-7035-4674-99ff-35e2f14fc035'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:38.256230 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-730f138c-4473-4632-9050-92f2f83f7bf2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:08:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['237f95eb-7035-4674-99ff-35e2f14fc035'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:38.298784 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-ede7017d-6c70-4bb8-abdf-99d67af32d69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "DELETE /v2.0/floatingips/81fab793-8623-49ae-8bb9-30e9de6c0937 HTTP/1.1" status: 204 len: 168 time: 1.1274297 Aug 24 03:08:38.299658 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:08:38.302706 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ecedae7-f9e7-41c4-8c46-51f5c4164868" -d '{"events": [{"name": "network-changed", "server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:08:38.381860 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:08:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6caa071c-abfd-40ea-8f49-55630f478a33 x-openstack-request-id: req-6caa071c-abfd-40ea-8f49-55630f478a33 {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:08:38.382151 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:08:38.382403 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-6caa071c-abfd-40ea-8f49-55630f478a33 {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:08:38.382819 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'status': 'completed', 'code': 200} Aug 24 03:08:38.403488 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-730f138c-4473-4632-9050-92f2f83f7bf2 None None] Set router 237f95eb-7035-4674-99ff-35e2f14fc035 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:38.605202 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a68497cd-15fd-4464-82d2-1a53f66bbbc5 req-d6ed6f63-9099-4cfc-945a-1436fb398da7 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:38.606951 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a68497cd-15fd-4464-82d2-1a53f66bbbc5 req-d6ed6f63-9099-4cfc-945a-1436fb398da7 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.0687358 Aug 24 03:08:38.669474 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a68497cd-15fd-4464-82d2-1a53f66bbbc5 req-d7156ca3-7b21-4b56-8d8a-a5b1a4ce3f63 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558417 Aug 24 03:08:38.680029 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:38.733059 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-730f138c-4473-4632-9050-92f2f83f7bf2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:03:38Z', 'revision_number': 4, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'a4f138f6-af08-4d87-a100-5579647b168d', 'name': '', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'mac_address': 'fa:16:3e:c0:7f:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_interface', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:37Z', 'updated_at': '2021-08-24T03:03:43Z', 'revision_number': 5, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'subnets': [{'id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:38.766987 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-730f138c-4473-4632-9050-92f2f83f7bf2 None None] Checking router: 237f95eb-7035-4674-99ff-35e2f14fc035 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:08:38.779656 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-730f138c-4473-4632-9050-92f2f83f7bf2 None None] Routers {'237f95eb-7035-4674-99ff-35e2f14fc035'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:38.781173 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-730f138c-4473-4632-9050-92f2f83f7bf2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:08:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['237f95eb-7035-4674-99ff-35e2f14fc035'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:38.816704 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-475b76d1-3255-4ee8-a2ab-8d08d085d2a0 req-ba483114-da59-4650-a85b-0997c930d69c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:38.825276 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-475b76d1-3255-4ee8-a2ab-8d08d085d2a0 req-ba483114-da59-4650-a85b-0997c930d69c tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0857272 Aug 24 03:08:38.873126 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-475b76d1-3255-4ee8-a2ab-8d08d085d2a0 req-d773c98b-f16d-4f37-817f-86f6e387bfb8 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465581 Aug 24 03:08:38.938577 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-730f138c-4473-4632-9050-92f2f83f7bf2 None None] Set router 237f95eb-7035-4674-99ff-35e2f14fc035 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:39.158963 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-730f138c-4473-4632-9050-92f2f83f7bf2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:03:38Z', 'revision_number': 4, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'a4f138f6-af08-4d87-a100-5579647b168d', 'name': '', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'mac_address': 'fa:16:3e:c0:7f:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_interface', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:37Z', 'updated_at': '2021-08-24T03:03:43Z', 'revision_number': 5, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'subnets': [{'id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:39.186859 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-730f138c-4473-4632-9050-92f2f83f7bf2 None None] The sync data for ids ['237f95eb-7035-4674-99ff-35e2f14fc035'] in dv-cinder-803748-8-iscsi is: [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:03:38Z', 'revision_number': 4, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'a4f138f6-af08-4d87-a100-5579647b168d', 'name': '', 'network_id': '866d4604-551e-4da3-b89c-967338dbafff', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'mac_address': 'fa:16:3e:c0:7f:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_interface', 'standard_attr_id': 431, 'fixed_ips': [{'subnet_id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:37Z', 'updated_at': '2021-08-24T03:03:43Z', 'revision_number': 5, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'subnets': [{'id': '4ffb6451-69cb-476e-bc2e-5b6165a067b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:08:39.452179 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-728bac15-8d99-4dbc-980e-374d900fb379 None None] New status for floating IP 81fab793-8623-49ae-8bb9-30e9de6c0937: DOWN {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:08:39.797034 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa558ab9-6d08-4d69-9e58-b2e43a42a98c req-35789474-dbce-440e-9254-ac73685bf492 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:39.799442 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-aa558ab9-6d08-4d69-9e58-b2e43a42a98c req-35789474-dbce-440e-9254-ac73685bf492 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.0519037 Aug 24 03:08:39.838209 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-aa558ab9-6d08-4d69-9e58-b2e43a42a98c req-368fc925-d49f-4b2c-89ab-4328526c8423 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323911 Aug 24 03:08:39.992073 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea1b9141-4aaf-47c1-b198-2861e1906f32 req-8dd9882e-797a-43ae-b790-531a53921212 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:39.993837 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ea1b9141-4aaf-47c1-b198-2861e1906f32 req-8dd9882e-797a-43ae-b790-531a53921212 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0528781 Aug 24 03:08:40.032224 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ea1b9141-4aaf-47c1-b198-2861e1906f32 req-4e1adae5-5208-42c2-bf6c-6ba34ebb2b67 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0324366 Aug 24 03:08:40.965392 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffdf605d-cff6-4b9f-8336-564285192d2d req-00ff9e0c-6175-4199-a690-3c89a8074ea1 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:40.966895 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ffdf605d-cff6-4b9f-8336-564285192d2d req-00ff9e0c-6175-4199-a690-3c89a8074ea1 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.0519581 Aug 24 03:08:41.012489 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ffdf605d-cff6-4b9f-8336-564285192d2d req-b6d8925a-0bdd-40bc-ab49-e8b4a34b84b0 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388596 Aug 24 03:08:41.165490 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6af8c335-ac12-40c1-aaed-010e2ba888ca req-eff7fed2-0bd0-44e1-b8ca-908335c403ee tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:41.168208 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6af8c335-ac12-40c1-aaed-010e2ba888ca req-eff7fed2-0bd0-44e1-b8ca-908335c403ee tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0561702 Aug 24 03:08:41.209373 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-6af8c335-ac12-40c1-aaed-010e2ba888ca req-38659b21-f48f-4b63-831f-b8774162236a tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0344806 Aug 24 03:08:42.152091 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5b7aa99-55a2-49f3-9a8c-46cf2fad463e req-a5b6ed3f-9b6b-4cff-b11f-d0c058a4875f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:42.153836 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d5b7aa99-55a2-49f3-9a8c-46cf2fad463e req-a5b6ed3f-9b6b-4cff-b11f-d0c058a4875f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.0630002 Aug 24 03:08:42.203900 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d5b7aa99-55a2-49f3-9a8c-46cf2fad463e req-36562ec6-7c10-4472-9cee-6e4761dd7acb tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440931 Aug 24 03:08:42.339411 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f72e0460-4d94-4a81-a091-374f6021cecc req-d0337a70-bfd3-4239-a9b9-e69036e6791f tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:42.341058 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f72e0460-4d94-4a81-a091-374f6021cecc req-d0337a70-bfd3-4239-a9b9-e69036e6791f tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0513246 Aug 24 03:08:42.386088 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f72e0460-4d94-4a81-a091-374f6021cecc req-b11d9500-556c-4db2-a911-e60c5051853f tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388660 Aug 24 03:08:43.345434 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7a254b-a839-4979-b2fa-b317135fadd6 req-fbb65774-0495-4e63-acf4-fb2e2dddbc11 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:43.347157 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0a7a254b-a839-4979-b2fa-b317135fadd6 req-fbb65774-0495-4e63-acf4-fb2e2dddbc11 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.0642202 Aug 24 03:08:43.386105 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0a7a254b-a839-4979-b2fa-b317135fadd6 req-268e1dab-656d-4f32-833d-8d1bc27d76a9 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327902 Aug 24 03:08:43.525960 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f1ecc73-0b7b-4bd9-8f5a-61f4e6b69e2f req-229a5f62-8593-47ea-bad0-4225f1b1cd69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:43.527651 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5f1ecc73-0b7b-4bd9-8f5a-61f4e6b69e2f req-229a5f62-8593-47ea-bad0-4225f1b1cd69 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0515273 Aug 24 03:08:43.566984 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5f1ecc73-0b7b-4bd9-8f5a-61f4e6b69e2f req-afea1fa4-2c9d-4d99-a827-34f785adaa72 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0329628 Aug 24 03:08:43.826796 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41506) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:43.952646 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4838671c-678a-4a96-8533-cafe7149942b admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:44.042551 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4838671c-678a-4a96-8533-cafe7149942b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:44.120539 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4838671c-678a-4a96-8533-cafe7149942b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:44.160065 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-4838671c-678a-4a96-8533-cafe7149942b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=5de68b14a5f24cc29e6b3c1b184d8c32&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3318126 Aug 24 03:08:44.160690 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4838671c-678a-4a96-8533-cafe7149942b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=886c0da9-bd19-4b74-b049-c42f809c36cb,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:44.163063 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41512) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:44.224392 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-97732a67-0d48-4369-8d5d-a0a499bf521a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:44.251266 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-97732a67-0d48-4369-8d5d-a0a499bf521a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:44.357754 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-97732a67-0d48-4369-8d5d-a0a499bf521a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:44.360546 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-97732a67-0d48-4369-8d5d-a0a499bf521a admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:44.361819 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-97732a67-0d48-4369-8d5d-a0a499bf521a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/886c0da9-bd19-4b74-b049-c42f809c36cb HTTP/1.1" status: 204 len: 168 time: 0.1978142 Aug 24 03:08:44.371331 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97732a67-0d48-4369-8d5d-a0a499bf521a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=886c0da9-bd19-4b74-b049-c42f809c36cb,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:44.518764 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41547fd9-3ef1-4a09-adc2-e73bf516193a req-519de46d-e83d-4362-971f-6c6379f3d6b4 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:44.520306 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-41547fd9-3ef1-4a09-adc2-e73bf516193a req-519de46d-e83d-4362-971f-6c6379f3d6b4 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.0531018 Aug 24 03:08:44.561226 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-41547fd9-3ef1-4a09-adc2-e73bf516193a req-4587a4c4-dd41-453f-a882-f91d3d967715 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340979 Aug 24 03:08:44.716176 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe334a16-d429-4dd5-9fc6-85dd9a6f2a91 req-a3ed5a3c-88e3-42d7-86f7-11c070a56f9b tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:44.717555 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fe334a16-d429-4dd5-9fc6-85dd9a6f2a91 req-a3ed5a3c-88e3-42d7-86f7-11c070a56f9b tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0512507 Aug 24 03:08:44.760383 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-fe334a16-d429-4dd5-9fc6-85dd9a6f2a91 req-e9ad93e2-6103-4f5a-9773-90fc3c94e077 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0367281 Aug 24 03:08:45.564843 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41540) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:45.689030 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-527459915-network', 'tenant_id': '340ed71ecf6140648b1ec802f4c9aacb'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:45.720345 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96657c31-622a-4878-9cc3-3a259161eaa6 req-83a076b7-90b6-4898-8ce9-00d6107bf525 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:45.722604 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-96657c31-622a-4878-9cc3-3a259161eaa6 req-83a076b7-90b6-4898-8ce9-00d6107bf525 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.0748351 Aug 24 03:08:45.762550 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-96657c31-622a-4878-9cc3-3a259161eaa6 req-32d58d38-fbdf-4886-853a-b87d51a79da1 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0343792 Aug 24 03:08:45.800290 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Made reservation on behalf of 340ed71ecf6140648b1ec802f4c9aacb for: {'network': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:08:45.802910 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for network, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:45.814036 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:45.888779 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa5feb7c-75a0-43e4-86aa-6a10351a839f req-ad51de22-f429-4bee-b0c8-b0dd606f6811 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:45.890420 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-aa5feb7c-75a0-43e4-86aa-6a10351a839f req-ad51de22-f429-4bee-b0c8-b0dd606f6811 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0492790 Aug 24 03:08:45.920016 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:45.933647 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-aa5feb7c-75a0-43e4-86aa-6a10351a839f req-89000fe4-8fab-4be9-b66c-952021358fab tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0368462 Aug 24 03:08:45.989038 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:46.015040 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] vlan segment allocate from pool success with {'vlan_id': 380, 'physical_network': 'physnet1'} {{(pid=111276) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Aug 24 03:08:46.024789 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a9da183-f230-46b4-b86f-b6b653e320d5,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:46.038601 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:46.038601 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.segments_db [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Added segment ee1686bb-3a57-460c-84bb-9999e3dc5965 of type vlan for network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f Aug 24 03:08:46.083190 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732363795788'] for network, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:46.171537 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228'] for network, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:46.172560 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:46.173150 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:46.233191 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] Pushing event updated for resources: {'Network': ['ID=adbf6887-7b6e-435d-a4f0-ee186fa9ca6f,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:46.247622 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f details requested by agent ovs-agent-dv-cinder-803748-8-iscsi with host dv-cinder-803748-8-iscsi {{(pid=111277) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Aug 24 03:08:46.286651 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-af7cf1b9-4023-4a88-823a-99d665861f86 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.7206001 Aug 24 03:08:46.289453 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41548) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:46.294709 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Request body: {'subnet': {'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-527459915-subnet', 'tenant_id': '340ed71ecf6140648b1ec802f4c9aacb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:46.377426 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Made reservation on behalf of 340ed71ecf6140648b1ec802f4c9aacb for: {'subnet': 1} {{(pid=111275) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:08:46.379947 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3378795'] for subnet, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:46.611917 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-3483122', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3378713'] for subnet, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:46.672638 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=627c2f10-e51d-47e0-a5a8-56279d49e835,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:46.689785 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:46.690142 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:46.690458 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:46.690786 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:46.691106 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:46.691429 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:46.691749 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:46.692074 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:46.692393 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:46.692709 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:46.693021 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:46.693510 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:08:46.700144 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Checking segment: {'id': 'ee1686bb-3a57-460c-84bb-9999e3dc5965', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111275) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:08:46.700575 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Network hostable DHCP agents. Network: adbf6887-7b6e-435d-a4f0-ee186fa9ca6f, hostable agents: ['0f342875-a02d-49bd-9bfb-7d878efb1db0'], hosted agents: [] {{(pid=111275) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Aug 24 03:08:46.800375 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f is scheduled to be hosted by DHCP agent 0f342875-a02d-49bd-9bfb-7d878efb1db0 with binding_index 1 {{(pid=111275) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Aug 24 03:08:46.875494 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-803748-8-iscsi, adbf6887-7b6e-435d-a4f0-ee186fa9ca6f) {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:46.881543 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:46.882608 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:46.887341 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e16b4e08-25c2-468d-a031-d745b180a62f None None] Network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:08:46.889840 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10c87133-b8b5-4198-8a53-11abb3988a5f req-ef679435-5dc4-44bf-b973-6e7343af4dea tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:46.891131 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-10c87133-b8b5-4198-8a53-11abb3988a5f req-ef679435-5dc4-44bf-b973-6e7343af4dea tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.0564954 Aug 24 03:08:46.931984 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-10c87133-b8b5-4198-8a53-11abb3988a5f req-c27b216a-54ee-4f03-a9d0-c84d1ba2c806 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341198 Aug 24 03:08:46.990580 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-edcc384f-ac9b-4b99-99c5-475cd4f65ea4 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6999481 Aug 24 03:08:47.042930 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-abb769fc-d070-4c88-a18d-491e3dca6a81 None None] Network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:08:47.333961 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ad652d-11dd-4e94-940d-0993d4c2f1ec req-a392deac-972c-45e1-a77a-c021cdad5745 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:47.336081 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-97ad652d-11dd-4e94-940d-0993d4c2f1ec req-a392deac-972c-45e1-a77a-c021cdad5745 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0637207 Aug 24 03:08:47.376741 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-97ad652d-11dd-4e94-940d-0993d4c2f1ec req-f5310aa5-5c58-49a1-9286-94b1a7246073 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0339129 Aug 24 03:08:48.052363 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18023d38-940f-4bc7-9ab1-6de2c96c33b7 req-4cf80215-9d48-4703-8153-79107eb96773 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:48.054456 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-18023d38-940f-4bc7-9ab1-6de2c96c33b7 req-4cf80215-9d48-4703-8153-79107eb96773 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.0496206 Aug 24 03:08:48.098248 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-18023d38-940f-4bc7-9ab1-6de2c96c33b7 req-098a045a-79db-4678-998b-5c9d4e448778 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355654 Aug 24 03:08:48.504530 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69517b6b-bb20-444d-9018-1830d12be376 req-317886a3-f0c2-45e0-a399-08136bf71154 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:48.506014 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-69517b6b-bb20-444d-9018-1830d12be376 req-317886a3-f0c2-45e0-a399-08136bf71154 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0524335 Aug 24 03:08:48.565910 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-2bac5cba-4a7f-4610-bf75-29bad678afa1 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9 HTTP/1.1" status: 200 len: 217 time: 0.0366166 Aug 24 03:08:48.568119 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-69517b6b-bb20-444d-9018-1830d12be376 req-13a223d7-2d1d-4d96-b298-7e872cf2fbb6 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0561824 Aug 24 03:08:48.583480 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-559ea4da-433b-492c-9e1c-a5d09fe5859b req-4d458702-6aef-4e80-95f5-9634b88c19da service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0502136 Aug 24 03:08:48.648132 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-beb0766a-1ab7-4544-8e9a-86a4f516859e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:48.649705 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-beb0766a-1ab7-4544-8e9a-86a4f516859e service neutron] 10.222.0.43 "GET /v2.0/subnets?id=f42fa902-0e1e-4185-b486-54648ea18f14 HTTP/1.1" status: 200 len: 854 time: 0.0538313 Aug 24 03:08:48.672711 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ecedae7-f9e7-41c4-8c46-51f5c4164868 req-3d32745d-fd17-4857-a803-64fa43df7512 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:48.674339 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4ecedae7-f9e7-41c4-8c46-51f5c4164868 req-3d32745d-fd17-4857-a803-64fa43df7512 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=8bca2ab0549a4f099c2421571c26f61b&device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 1098 time: 0.0431421 Aug 24 03:08:48.725278 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-66bdb1b1-0e76-4b61-b4c3-6b559669e5ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:48.726773 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-66bdb1b1-0e76-4b61-b4c3-6b559669e5ce service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0671980 Aug 24 03:08:48.729240 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559ea4da-433b-492c-9e1c-a5d09fe5859b req-59327f84-f40f-4c84-bc9c-424a693a0b73 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:48.730637 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-559ea4da-433b-492c-9e1c-a5d09fe5859b req-59327f84-f40f-4c84-bc9c-424a693a0b73 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 1098 time: 0.0636904 Aug 24 03:08:48.769542 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ecedae7-f9e7-41c4-8c46-51f5c4164868 req-c4e6a321-9840-4526-bebb-06659aeddb27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:48.770949 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4ecedae7-f9e7-41c4-8c46-51f5c4164868 req-c4e6a321-9840-4526-bebb-06659aeddb27 service neutron] 10.222.0.43 "GET /v2.0/networks?id=866d4604-551e-4da3-b89c-967338dbafff HTTP/1.1" status: 200 len: 910 time: 0.0896935 Aug 24 03:08:48.812727 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4ecedae7-f9e7-41c4-8c46-51f5c4164868 req-f2342bf3-006b-409b-a1cb-2b21680fe0ba service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09 HTTP/1.1" status: 200 len: 217 time: 0.0335045 Aug 24 03:08:48.862992 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ecedae7-f9e7-41c4-8c46-51f5c4164868 req-219cb377-e57d-48c5-9f4a-c223cb538ce3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:48.864435 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4ecedae7-f9e7-41c4-8c46-51f5c4164868 req-219cb377-e57d-48c5-9f4a-c223cb538ce3 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=4ffb6451-69cb-476e-bc2e-5b6165a067b1 HTTP/1.1" status: 200 len: 848 time: 0.0439136 Aug 24 03:08:48.882575 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-ed48fd5f-bd44-4875-ad36-8264ceb4623c service neutron] 10.222.0.43 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1459191 Aug 24 03:08:48.904537 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559ea4da-433b-492c-9e1c-a5d09fe5859b req-7e9c2b99-fb32-4508-98c9-d8f87e75348a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:48.905983 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-559ea4da-433b-492c-9e1c-a5d09fe5859b req-7e9c2b99-fb32-4508-98c9-d8f87e75348a service neutron] 10.222.0.43 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 913 time: 0.1527622 Aug 24 03:08:48.913768 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ecedae7-f9e7-41c4-8c46-51f5c4164868 req-e4bbd6c2-3bcd-4030-9c58-02b53f93c3b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:48.915236 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4ecedae7-f9e7-41c4-8c46-51f5c4164868 req-e4bbd6c2-3bcd-4030-9c58-02b53f93c3b1 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=866d4604-551e-4da3-b89c-967338dbafff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0439487 Aug 24 03:08:49.005340 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4ecedae7-f9e7-41c4-8c46-51f5c4164868 req-185e8b73-6b82-40d5-9f40-3aef09057f29 service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825911 Aug 24 03:08:49.015383 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-559ea4da-433b-492c-9e1c-a5d09fe5859b req-96627a26-cb02-455f-913d-775e9844a118 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a8f7945f-96cc-40aa-897c-b9f7dd88be75 HTTP/1.1" status: 200 len: 1001 time: 0.1004794 Aug 24 03:08:49.057270 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9fdc9e67-0165-4d02-858c-af038aed6728 req-eb6ae2b4-d884-4d55-8d75-211e4d17fe4f service neutron] 10.222.0.43 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1671498 Aug 24 03:08:49.073077 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559ea4da-433b-492c-9e1c-a5d09fe5859b req-49f53038-bbac-4d98-a1bf-8175a1d188f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:49.075249 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-559ea4da-433b-492c-9e1c-a5d09fe5859b req-49f53038-bbac-4d98-a1bf-8175a1d188f1 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 200 len: 851 time: 0.0494628 Aug 24 03:08:49.106143 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-4ecedae7-f9e7-41c4-8c46-51f5c4164868 req-61d592f6-5dac-4968-b7a4-bde09090491e service neutron] 10.222.0.43 "GET /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893819 Aug 24 03:08:49.135225 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559ea4da-433b-492c-9e1c-a5d09fe5859b req-efa960da-98dd-43b0-a20d-99ec0d23aafa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:49.137594 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-559ea4da-433b-492c-9e1c-a5d09fe5859b req-efa960da-98dd-43b0-a20d-99ec0d23aafa service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0543649 Aug 24 03:08:49.269014 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecf454ec-ef0c-4296-ab8a-a04e490bd346 req-e018d4e2-8fe0-4906-b1ae-cfc230b14232 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:49.270600 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ecf454ec-ef0c-4296-ab8a-a04e490bd346 req-e018d4e2-8fe0-4906-b1ae-cfc230b14232 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.1038072 Aug 24 03:08:49.276277 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-559ea4da-433b-492c-9e1c-a5d09fe5859b req-8582fda4-12f9-4909-910e-f4868a9fe588 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1314795 Aug 24 03:08:49.330529 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-d99e41e6-d90d-44b6-862a-80fe714b2f70 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:49.331932 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-d99e41e6-d90d-44b6-862a-80fe714b2f70 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/networks?id=adbf6887-7b6e-435d-a4f0-ee186fa9ca6f HTTP/1.1" status: 200 len: 808 time: 0.1087694 Aug 24 03:08:49.347027 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-3c1d4108-e896-4e95-b51b-15b7fb42ed52 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/quotas/340ed71ecf6140648b1ec802f4c9aacb HTTP/1.1" status: 200 len: 375 time: 0.0091465 Aug 24 03:08:49.358680 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ecf454ec-ef0c-4296-ab8a-a04e490bd346 req-05439688-8461-4265-b098-0899bab00f30 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0813770 Aug 24 03:08:49.379537 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-92f4018e-6859-4e32-a1f3-5fc0cbc7156b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=340ed71ecf6140648b1ec802f4c9aacb&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0271065 Aug 24 03:08:49.396904 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-559ea4da-433b-492c-9e1c-a5d09fe5859b req-13c58b8f-ba71-47ec-826b-8da8f5a438f3 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1066265 Aug 24 03:08:49.684490 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab937e1f-a89b-4792-bef5-5f08b6d9629d req-d31fadb2-7ef5-4594-87f5-5aa5240cc13d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:49.686000 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ab937e1f-a89b-4792-bef5-5f08b6d9629d req-d31fadb2-7ef5-4594-87f5-5aa5240cc13d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0506527 Aug 24 03:08:49.719443 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-69798e5b-7b22-4f28-9cc6-8b04bed5945c service neutron] 10.222.0.30 "GET /v2.0/networks/adbf6887-7b6e-435d-a4f0-ee186fa9ca6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3326473 Aug 24 03:08:49.726154 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ab937e1f-a89b-4792-bef5-5f08b6d9629d req-003bebb5-5f50-47eb-9836-199605c9939d tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0340233 Aug 24 03:08:49.811178 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-e3b86b78-86b4-41c8-90be-2bd95f7c010e service neutron] 10.222.0.30 "GET /v2.0/networks/adbf6887-7b6e-435d-a4f0-ee186fa9ca6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857041 Aug 24 03:08:50.390724 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96451f60-493e-4ddf-821a-43d91bae296f req-c9d079f6-425a-4a9c-840e-04429cbf5737 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:50.392211 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-96451f60-493e-4ddf-821a-43d91bae296f req-c9d079f6-425a-4a9c-840e-04429cbf5737 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.43 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0505214 Aug 24 03:08:50.763818 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5bcdd15-1b2d-4365-8129-1ca604cfd5b6 req-50c4c634-1ffc-42c2-91de-96dd7fcab96c tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:50.765326 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b5bcdd15-1b2d-4365-8129-1ca604cfd5b6 req-50c4c634-1ffc-42c2-91de-96dd7fcab96c tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.3357351 Aug 24 03:08:50.792725 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-96451f60-493e-4ddf-821a-43d91bae296f req-9c72344e-5b25-4a43-a3c6-3271231da5db tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Deleting port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:08:50.793097 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-96451f60-493e-4ddf-821a-43d91bae296f req-9c72344e-5b25-4a43-a3c6-3271231da5db tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:50.853456 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b5bcdd15-1b2d-4365-8129-1ca604cfd5b6 req-4cc80773-2e36-45bf-a535-2c1459d1fd39 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0813351 Aug 24 03:08:50.898379 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-96451f60-493e-4ddf-821a-43d91bae296f req-9c72344e-5b25-4a43-a3c6-3271231da5db tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] For port 8069cbc1-7d07-44d4-b500-7a5a4c751d09, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=8069cbc1-7d07-44d4-b500-7a5a4c751d09,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:50.898675 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-96451f60-493e-4ddf-821a-43d91bae296f req-9c72344e-5b25-4a43-a3c6-3271231da5db tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:50.912131 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-96451f60-493e-4ddf-821a-43d91bae296f req-9c72344e-5b25-4a43-a3c6-3271231da5db tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Calling delete_port for 8069cbc1-7d07-44d4-b500-7a5a4c751d09 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:08:51.009368 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-218982dc-d92f-48d8-9555-22e5859a4721 req-ec569ea2-3c29-4ece-8896-662d002f6ed8 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:51.010915 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-218982dc-d92f-48d8-9555-22e5859a4721 req-ec569ea2-3c29-4ece-8896-662d002f6ed8 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 945 time: 0.0999587 Aug 24 03:08:51.024880 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2930bdab-901a-4a8e-8823-8b1ecdacc44f req-53944f5f-a800-4928-a4d8-9d906a182a0d tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 210 time: 0.0352409 Aug 24 03:08:51.061997 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-218982dc-d92f-48d8-9555-22e5859a4721 req-67a87184-72f3-41b5-86bc-330ac65f18a5 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/security-groups?id=e415ccde-c5f3-41fa-a088-107816b2da10&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0352304 Aug 24 03:08:51.203303 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-96451f60-493e-4ddf-821a-43d91bae296f req-9c72344e-5b25-4a43-a3c6-3271231da5db tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:51.232772 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c72344e-5b25-4a43-a3c6-3271231da5db tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event deleted for resources: {'Port': ['ID=8069cbc1-7d07-44d4-b500-7a5a4c751d09,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:51.278654 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-96451f60-493e-4ddf-821a-43d91bae296f req-9c72344e-5b25-4a43-a3c6-3271231da5db tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] No DVR routers for this DVR port 8069cbc1-7d07-44d4-b500-7a5a4c751d09 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:08:51.281242 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-96451f60-493e-4ddf-821a-43d91bae296f req-9c72344e-5b25-4a43-a3c6-3271231da5db tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:51.283270 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-96451f60-493e-4ddf-821a-43d91bae296f req-9c72344e-5b25-4a43-a3c6-3271231da5db tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.43 "DELETE /v2.0/ports/8069cbc1-7d07-44d4-b500-7a5a4c751d09 HTTP/1.1" status: 204 len: 173 time: 0.8848009 Aug 24 03:08:51.288314 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'name': 'network-vif-deleted', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:08:51.288314 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-399c7478-fd59-4e50-8b16-cb29c4ac54c5" -d '{"events": [{"server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "name": "network-vif-deleted", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:08:51.323272 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:08:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18a85f47-b93a-4303-8773-cf426f416506 x-openstack-request-id: req-18a85f47-b93a-4303-8773-cf426f416506 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:08:51.323555 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "379c8fa5-3d34-432b-be99-2b3858b7457b", "name": "network-vif-deleted", "tag": "8069cbc1-7d07-44d4-b500-7a5a4c751d09", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:08:51.323800 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-18a85f47-b93a-4303-8773-cf426f416506 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:08:51.324186 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '379c8fa5-3d34-432b-be99-2b3858b7457b', 'name': 'network-vif-deleted', 'tag': '8069cbc1-7d07-44d4-b500-7a5a4c751d09', 'status': 'completed', 'code': 200} Aug 24 03:08:51.534398 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-20244621-2ce8-4977-b1ae-13489c0d2174 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:51.765468 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device c163baa9-83ec-4da5-a79e-088fea86e5c9 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:08:51.859926 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port c163baa9-83ec-4da5-a79e-088fea86e5c9, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:51.871865 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'port_id': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'mac_address': 'fa:16:3e:6a:37:02', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:08:51.909429 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:51.925921 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c163baa9-83ec-4da5-a79e-088fea86e5c9 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:08:51.946613 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port c163baa9-83ec-4da5-a79e-088fea86e5c9, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:51.968629 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff3ef730-2bd6-4233-8c8e-f74eec250373 req-bed093d4-38f1-483d-a4cf-5c4ac2287da7 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:51.972092 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ff3ef730-2bd6-4233-8c8e-f74eec250373 req-bed093d4-38f1-483d-a4cf-5c4ac2287da7 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 943 time: 0.0499032 Aug 24 03:08:52.010087 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ff3ef730-2bd6-4233-8c8e-f74eec250373 req-1c233032-997c-4c84-8146-e25bf5485547 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0339310 Aug 24 03:08:52.068581 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:52.116018 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-795f0b08-aac4-4b38-b21f-0b014ea9c8fb req-283fd107-d482-4f9a-b716-ef402e54ecd5 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 210 time: 0.0288763 Aug 24 03:08:52.117883 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=c163baa9-83ec-4da5-a79e-088fea86e5c9,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:52.160763 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9eb47269-b903-458e-ae85-18120957bc01 req-0d16688d-a26b-4f6a-a27a-9d0759c27206 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "GET /v2.0/ports?device_id=379c8fa5-3d34-432b-be99-2b3858b7457b HTTP/1.1" status: 200 len: 210 time: 0.0270095 Aug 24 03:08:52.284425 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['c163baa9-83ec-4da5-a79e-088fea86e5c9'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:08:53.124591 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416b3068-f56f-407c-a6e8-78f2c2ad84da req-1fc7495c-01b3-4fee-9822-78e17197e48d tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:53.126093 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-416b3068-f56f-407c-a6e8-78f2c2ad84da req-1fc7495c-01b3-4fee-9822-78e17197e48d tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 944 time: 0.0486012 Aug 24 03:08:53.169231 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-416b3068-f56f-407c-a6e8-78f2c2ad84da req-1f8e86be-e518-42e9-b6fd-b33250158ab4 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360107 Aug 24 03:08:53.217851 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41618) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:53.221245 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-2c9a888a-0a97-4245-8f8e-e0d4eff59837 req-10676767-e70f-4b81-9e14-512977b35ecd tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 210 time: 0.0296044 Aug 24 03:08:53.277097 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-014e9955-d692-4a4b-90d5-04102a40c3c3 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:53.302095 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-014e9955-d692-4a4b-90d5-04102a40c3c3 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:53.426151 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-014e9955-d692-4a4b-90d5-04102a40c3c3 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:53.429048 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-014e9955-d692-4a4b-90d5-04102a40c3c3 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:53.430388 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-014e9955-d692-4a4b-90d5-04102a40c3c3 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] 10.222.0.30 "DELETE /v2.0/security-groups/e415ccde-c5f3-41fa-a088-107816b2da10 HTTP/1.1" status: 204 len: 168 time: 0.2114458 Aug 24 03:08:53.441611 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-ae3f4f5a-7cfc-4a7a-b0ce-290e9d9634f5 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:53.443116 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-ae3f4f5a-7cfc-4a7a-b0ce-290e9d9634f5 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.43 "GET /v2.0/networks?id=adbf6887-7b6e-435d-a4f0-ee186fa9ca6f HTTP/1.1" status: 200 len: 808 time: 0.1102071 Aug 24 03:08:53.444548 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-014e9955-d692-4a4b-90d5-04102a40c3c3 tempest-TestShelveInstance-449882683 tempest-TestShelveInstance-449882683-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e415ccde-c5f3-41fa-a088-107816b2da10,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:53.457225 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Request body: {'port': {'device_id': '32bb6e13-dd0a-423c-96d5-64b73513966a', 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f', 'admin_state_up': True, 'tenant_id': '340ed71ecf6140648b1ec802f4c9aacb'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:53.551546 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41622) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:53.648937 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Made reservation on behalf of 340ed71ecf6140648b1ec802f4c9aacb for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:08:53.653200 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:53.765382 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device c163baa9-83ec-4da5-a79e-088fea86e5c9 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:08:53.796079 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Allocated IP 172.20.0.2 (adbf6887-7b6e-435d-a4f0-ee186fa9ca6f/627c2f10-e51d-47e0-a5a8-56279d49e835/7819f603-cd75-4d4d-953d-fe791a928097) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:08:53.895400 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port c163baa9-83ec-4da5-a79e-088fea86e5c9 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:08:53.901427 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port c163baa9-83ec-4da5-a79e-088fea86e5c9 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:08:53.901835 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:53.953379 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0229e957-4cad-4fff-806f-a22ea80cb219 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-566649'] for router_interface, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:53.953671 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:53.969030 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-8e65ba12-f02f-481b-87ec-48628b38c7c7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:53.984483 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:54.007453 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:08:54.009744 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d04e2a7-d1e6-4419-88c5-ef7aa1c83e6f" -d '{"events": [{"server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "name": "network-vif-plugged", "status": "completed", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:08:54.022562 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port c163baa9-83ec-4da5-a79e-088fea86e5c9, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:54.048680 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:08:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c865a2f6-4600-4963-9cae-5389c9f3abb1 x-openstack-request-id: req-c865a2f6-4600-4963-9cae-5389c9f3abb1 {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:08:54.048970 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "name": "network-vif-plugged", "status": "completed", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:08:54.049237 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c865a2f6-4600-4963-9cae-5389c9f3abb1 {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:08:54.049658 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'code': 200} Aug 24 03:08:54.054947 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:54.101437 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:08:54.104825 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:08:54.112056 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:08:54.115955 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Pushing event updated for resources: {'Port': ['ID=7819f603-cd75-4d4d-953d-fe791a928097,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:54.121268 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:54.126067 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 8069cbc1-7d07-44d4-b500-7a5a4c751d09 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:08:54.150659 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 8069cbc1-7d07-44d4-b500-7a5a4c751d09 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:08:54.150975 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 8069cbc1-7d07-44d4-b500-7a5a4c751d09 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:08:54.163514 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:54.164119 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:54.201615 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=c163baa9-83ec-4da5-a79e-088fea86e5c9,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:54.228589 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-0229e957-4cad-4fff-806f-a22ea80cb219 admin admin] Deleting port a4f138f6-af08-4d87-a100-5579647b168d {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:08:54.229143 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0229e957-4cad-4fff-806f-a22ea80cb219 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:54.235249 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-f0fda9df-359e-40b9-af40-01f2981e8583 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7821546 Aug 24 03:08:54.249027 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Request body: {'port': {'device_id': '32bb6e13-dd0a-423c-96d5-64b73513966a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:08:54.352041 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:54.352936 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:54.373499 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-0229e957-4cad-4fff-806f-a22ea80cb219 admin admin] For port a4f138f6-af08-4d87-a100-5579647b168d, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=a4f138f6-af08-4d87-a100-5579647b168d,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:54.373883 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0229e957-4cad-4fff-806f-a22ea80cb219 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:54.392462 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c5a6861-4ade-4126-b34a-ae0a1bbc8b2c req-47d763d5-3a2e-45eb-9cf4-f47ca4ed933a tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:54.393990 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8c5a6861-4ade-4126-b34a-ae0a1bbc8b2c req-47d763d5-3a2e-45eb-9cf4-f47ca4ed933a tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 945 time: 0.1225157 Aug 24 03:08:54.396676 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdb7046f-01f4-45e3-84d4-10553f119951 req-6218c316-dbde-407b-9694-df00ab1e11ad tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:54.398198 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bdb7046f-01f4-45e3-84d4-10553f119951 req-6218c316-dbde-407b-9694-df00ab1e11ad tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 931 time: 0.1004143 Aug 24 03:08:54.401067 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-0229e957-4cad-4fff-806f-a22ea80cb219 admin admin] Calling delete_port for a4f138f6-af08-4d87-a100-5579647b168d owned by network:router_interface {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:08:54.464654 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf5b3109-5194-4d31-a187-cb9d9541054c req-9ca5d2d5-7de0-4d75-8313-be8276b004d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:54.467057 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-cf5b3109-5194-4d31-a187-cb9d9541054c req-9ca5d2d5-7de0-4d75-8313-be8276b004d5 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 1098 time: 0.1424072 Aug 24 03:08:54.511168 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-8c5a6861-4ade-4126-b34a-ae0a1bbc8b2c req-ae7c6d9f-f5d2-43b8-95f6-04d29f3a6e61 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1071436 Aug 24 03:08:54.525626 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bdb7046f-01f4-45e3-84d4-10553f119951 req-e34ab7fd-7973-40af-a816-41ed58230ef3 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1159592 Aug 24 03:08:54.545841 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-cf5b3109-5194-4d31-a187-cb9d9541054c req-7d3fe04c-6d17-492d-a75d-60f44cae6e50 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660715 Aug 24 03:08:54.689544 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7819f603-cd75-4d4d-953d-fe791a928097 {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:08:54.697175 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:54.734783 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Transition to ACTIVE for port object 7819f603-cd75-4d4d-953d-fe791a928097 will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:08:54.735012 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0229e957-4cad-4fff-806f-a22ea80cb219 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:54.765183 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0229e957-4cad-4fff-806f-a22ea80cb219 admin admin] Pushing event deleted for resources: {'Port': ['ID=a4f138f6-af08-4d87-a100-5579647b168d,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:54.803722 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:54.882118 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Pushing event updated for resources: {'Port': ['ID=7819f603-cd75-4d4d-953d-fe791a928097,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:54.936948 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Attempting to bind port 7819f603-cd75-4d4d-953d-fe791a928097 on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:08:54.937323 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Attempting to bind port 7819f603-cd75-4d4d-953d-fe791a928097 by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': 'ee1686bb-3a57-460c-84bb-9999e3dc5965', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:08:54.937628 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Attempting to bind port 7819f603-cd75-4d4d-953d-fe791a928097 on network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:08:54.943220 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Port 7819f603-cd75-4d4d-953d-fe791a928097 on network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:08:54.943543 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Attempting to bind port 7819f603-cd75-4d4d-953d-fe791a928097 on network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:08:54.948861 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 8, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:08:54.949138 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0229e957-4cad-4fff-806f-a22ea80cb219 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-748285', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-566109'] for router_interface, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:54.950032 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Checking segment: {'id': 'ee1686bb-3a57-460c-84bb-9999e3dc5965', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:08:54.950319 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Bound using segment: {'id': 'ee1686bb-3a57-460c-84bb-9999e3dc5965', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:08:54.950707 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Bound port: 7819f603-cd75-4d4d-953d-fe791a928097, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ee1686bb-3a57-460c-84bb-9999e3dc5965', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:08:54.951066 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:55.021946 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] For port 7819f603-cd75-4d4d-953d-fe791a928097, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:08:55.025304 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] For port 7819f603-cd75-4d4d-953d-fe791a928097, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=7819f603-cd75-4d4d-953d-fe791a928097,segment=NetworkSegment(ee1686bb-3a57-460c-84bb-9999e3dc5965),segment_id=ee1686bb-3a57-460c-84bb-9999e3dc5965)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:08:55.111775 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:55.153277 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:55.153927 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:55.155344 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] 10.222.0.43 "PUT /v2.0/ports/7819f603-cd75-4d4d-953d-fe791a928097 HTTP/1.1" status: 200 len: 1093 time: 0.9114828 Aug 24 03:08:55.155800 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '32bb6e13-dd0a-423c-96d5-64b73513966a', 'tag': '7819f603-cd75-4d4d-953d-fe791a928097'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:08:55.158114 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b7dfb9a5-f5d8-4b58-b374-93e67cb8f400" -d '{"events": [{"name": "network-changed", "server_uuid": "32bb6e13-dd0a-423c-96d5-64b73513966a", "tag": "7819f603-cd75-4d4d-953d-fe791a928097"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:08:55.179730 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0229e957-4cad-4fff-806f-a22ea80cb219 admin admin] Router 237f95eb-7035-4674-99ff-35e2f14fc035 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:08:55.200097 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ad08103-4fcf-4cd3-9807-7c8af293dcfa service neutron] Pushing event updated for resources: {'Port': ['ID=7819f603-cd75-4d4d-953d-fe791a928097,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:55.204916 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:08:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c3e97e0c-5b1f-4f57-9641-710520eb62c2 x-openstack-request-id: req-c3e97e0c-5b1f-4f57-9641-710520eb62c2 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:08:55.205993 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "32bb6e13-dd0a-423c-96d5-64b73513966a", "tag": "7819f603-cd75-4d4d-953d-fe791a928097", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:08:55.206257 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-c3e97e0c-5b1f-4f57-9641-710520eb62c2 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:08:55.207215 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '32bb6e13-dd0a-423c-96d5-64b73513966a', 'tag': '7819f603-cd75-4d4d-953d-fe791a928097', 'status': 'completed', 'code': 200} Aug 24 03:08:55.267054 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7dfb9a5-f5d8-4b58-b374-93e67cb8f400 req-2a0db76d-010a-4aca-821d-37005d3b661d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:55.268561 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b7dfb9a5-f5d8-4b58-b374-93e67cb8f400 req-2a0db76d-010a-4aca-821d-37005d3b661d service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=340ed71ecf6140648b1ec802f4c9aacb&device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 1096 time: 0.0414221 Aug 24 03:08:55.296023 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0229e957-4cad-4fff-806f-a22ea80cb219 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:08:55.301545 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-0229e957-4cad-4fff-806f-a22ea80cb219 admin admin] 10.222.0.30 "PUT /v2.0/routers/237f95eb-7035-4674-99ff-35e2f14fc035/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7488685 Aug 24 03:08:55.310095 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41640) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:55.310221 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc622fff-4ea4-424e-9325-98fbdb75e792 None None] Sync routers for ids ['237f95eb-7035-4674-99ff-35e2f14fc035'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:08:55.320540 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc622fff-4ea4-424e-9325-98fbdb75e792 None None] Routers {'237f95eb-7035-4674-99ff-35e2f14fc035'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:55.321409 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-fc622fff-4ea4-424e-9325-98fbdb75e792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:08:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['237f95eb-7035-4674-99ff-35e2f14fc035'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:55.375775 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7dfb9a5-f5d8-4b58-b374-93e67cb8f400 req-18c29f39-55a6-4aa8-8b7c-0c69996bea03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:55.377261 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b7dfb9a5-f5d8-4b58-b374-93e67cb8f400 req-18c29f39-55a6-4aa8-8b7c-0c69996bea03 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=340ed71ecf6140648b1ec802f4c9aacb&shared=False HTTP/1.1" status: 200 len: 909 time: 0.1010227 Aug 24 03:08:55.412141 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Notify callbacks [] for router, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:55.435216 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-fc622fff-4ea4-424e-9325-98fbdb75e792 None None] Set router 237f95eb-7035-4674-99ff-35e2f14fc035 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:55.486179 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7dfb9a5-f5d8-4b58-b374-93e67cb8f400 req-dede2766-f725-4ead-b57b-126a3990e62d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:55.487624 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b7dfb9a5-f5d8-4b58-b374-93e67cb8f400 req-dede2766-f725-4ead-b57b-126a3990e62d service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1026287 Aug 24 03:08:55.522736 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:55.627429 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:55.649448 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-fc622fff-4ea4-424e-9325-98fbdb75e792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173'}], 'enable_snat': True}, 'gw_port_id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:08:54Z', 'revision_number': 5, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port': {'id': '2a166f3b-bb0b-4491-b944-aa2b23edd1b6', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:70:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'device_owner': 'network:router_gateway', 'standard_attr_id': 430, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:35Z', 'updated_at': '2021-08-24T03:03:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:55.659398 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-5971045c-e2ab-4d09-b4b2-93ed891892a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:55.666426 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-5971045c-e2ab-4d09-b4b2-93ed891892a4 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=340ed71ecf6140648b1ec802f4c9aacb&device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 1096 time: 0.1050024 Aug 24 03:08:55.682568 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc622fff-4ea4-424e-9325-98fbdb75e792 None None] Checking router: 237f95eb-7035-4674-99ff-35e2f14fc035 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:08:55.684301 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0abc7e-957a-4ac7-b802-faf5da05ebb5 req-a1abc92c-d57b-49f5-9928-e60b957d68ff tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:55.685941 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c3551e-aad0-42f1-b3a0-c22c255a359c req-3597fb82-a6f7-4e40-ab0c-043bba4f67ac tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:55.686128 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3f0abc7e-957a-4ac7-b802-faf5da05ebb5 req-a1abc92c-d57b-49f5-9928-e60b957d68ff tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 945 time: 0.0927150 Aug 24 03:08:55.687456 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-34c3551e-aad0-42f1-b3a0-c22c255a359c req-3597fb82-a6f7-4e40-ab0c-043bba4f67ac tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 943 time: 0.0831575 Aug 24 03:08:55.694675 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc622fff-4ea4-424e-9325-98fbdb75e792 None None] Routers {'237f95eb-7035-4674-99ff-35e2f14fc035'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:55.695414 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-fc622fff-4ea4-424e-9325-98fbdb75e792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:08:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['237f95eb-7035-4674-99ff-35e2f14fc035'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:55.714507 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Deleting port 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:08:55.715546 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:55.726888 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-6f74571a-aa01-46b4-ba5e-e58dbcea0663 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=7819f603-cd75-4d4d-953d-fe791a928097 HTTP/1.1" status: 200 len: 217 time: 0.0570047 Aug 24 03:08:55.792797 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-34c3551e-aad0-42f1-b3a0-c22c255a359c req-ab4ad203-65c6-402c-b69f-9e5171063417 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887938 Aug 24 03:08:55.794006 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3f0abc7e-957a-4ac7-b802-faf5da05ebb5 req-1dec34bd-6919-43ba-86e7-8beb667257de tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0744796 Aug 24 03:08:55.797993 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-87e2b778-b1d3-44ef-b51d-9ef73ca06dd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:55.799554 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-87e2b778-b1d3-44ef-b51d-9ef73ca06dd3 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=627c2f10-e51d-47e0-a5a8-56279d49e835 HTTP/1.1" status: 200 len: 848 time: 0.0636811 Aug 24 03:08:55.819784 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-fc622fff-4ea4-424e-9325-98fbdb75e792 None None] Set router 237f95eb-7035-4674-99ff-35e2f14fc035 gateway port host: None {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:55.828739 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] For port 2a166f3b-bb0b-4491-b944-aa2b23edd1b6, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=2a166f3b-bb0b-4491-b944-aa2b23edd1b6,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:55.829198 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:55.841869 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Calling delete_port for 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 owned by network:router_gateway {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:08:55.842185 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-d980cadc-2f39-4c50-ba71-04a93404dcf6 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=adbf6887-7b6e-435d-a4f0-ee186fa9ca6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0334232 Aug 24 03:08:55.878968 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-fc622fff-4ea4-424e-9325-98fbdb75e792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:08:55Z', 'revision_number': 6, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port_host': None}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:55.905936 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fc622fff-4ea4-424e-9325-98fbdb75e792 None None] The sync data for ids ['237f95eb-7035-4674-99ff-35e2f14fc035'] in dv-cinder-803748-8-iscsi is: [{'id': '237f95eb-7035-4674-99ff-35e2f14fc035', 'name': 'tempest-TestShelveInstance-1334498724-router', 'tenant_id': '8bca2ab0549a4f099c2421571c26f61b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:34Z', 'updated_at': '2021-08-24T03:08:55Z', 'revision_number': 6, 'project_id': '8bca2ab0549a4f099c2421571c26f61b', 'gw_port_host': None}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:08:55.941790 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-e2617dcd-78b6-4ba0-8595-197507752533 service neutron] 10.222.0.43 "GET /v2.0/networks/adbf6887-7b6e-435d-a4f0-ee186fa9ca6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0904071 Aug 24 03:08:56.031693 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0f6e3add-0876-44a0-abd7-601d9247d946 req-98f15884-7070-4ef6-8902-5d10cea1617c service neutron] 10.222.0.43 "GET /v2.0/networks/adbf6887-7b6e-435d-a4f0-ee186fa9ca6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832751 Aug 24 03:08:56.107097 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:56.138811 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Pushing event deleted for resources: {'Port': ['ID=2a166f3b-bb0b-4491-b944-aa2b23edd1b6,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:56.199851 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-569567'] for router_gateway, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:56.294710 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-560207', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32699'] for router, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:56.296865 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:56.671508 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557756'] for router, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:56.672073 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 237f95eb-7035-4674-99ff-35e2f14fc035 {{(pid=111275) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Aug 24 03:08:56.677211 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] Notify callbacks [] for router, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:56.678418 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-2bf950f9-db46-4d95-b2f2-0f1abccdf869 admin admin] 10.222.0.30 "DELETE /v2.0/routers/237f95eb-7035-4674-99ff-35e2f14fc035 HTTP/1.1" status: 204 len: 168 time: 1.3728952 Aug 24 03:08:56.680922 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41646) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:56.725158 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-0660da6d-631b-42ad-a1a6-1d7fa7a704ab admin admin] Deleting subnet 4ffb6451-69cb-476e-bc2e-5b6165a067b1 {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:08:56.728635 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0660da6d-631b-42ad-a1a6-1d7fa7a704ab admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:56.763705 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0660da6d-631b-42ad-a1a6-1d7fa7a704ab admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:56.852919 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0660da6d-631b-42ad-a1a6-1d7fa7a704ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:56.940783 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dcd434e-822e-4b71-8486-409cd5bd2a94 req-80caf72a-e1f0-4d62-bdb6-7e96f0ab92e2 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:56.940783 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0dcd434e-822e-4b71-8486-409cd5bd2a94 req-80caf72a-e1f0-4d62-bdb6-7e96f0ab92e2 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 945 time: 0.0613668 Aug 24 03:08:56.956891 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3565ca1a-4300-474e-8062-5535d4a00a7b req-328ae55b-05f8-4fea-94fe-0e784ce1d03d tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:56.958480 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3565ca1a-4300-474e-8062-5535d4a00a7b req-328ae55b-05f8-4fea-94fe-0e784ce1d03d tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 943 time: 0.0719540 Aug 24 03:08:56.985450 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0dcd434e-822e-4b71-8486-409cd5bd2a94 req-b22b08d6-2e3f-4059-9d9b-cb40a38873d4 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393455 Aug 24 03:08:56.998469 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3565ca1a-4300-474e-8062-5535d4a00a7b req-f3ac5e89-d703-41e3-97bb-d8b89089b626 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326099 Aug 24 03:08:57.026048 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.063403 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0660da6d-631b-42ad-a1a6-1d7fa7a704ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.096132 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-0660da6d-631b-42ad-a1a6-1d7fa7a704ab admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.101187 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52154dde-a279-4bbe-ac5c-2010794c7242 req-e988943f-d342-4d3e-9219-6a2dd7d42c7a tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:57.109772 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-0660da6d-631b-42ad-a1a6-1d7fa7a704ab admin admin] 10.222.0.30 "DELETE /v2.0/subnets/4ffb6451-69cb-476e-bc2e-5b6165a067b1 HTTP/1.1" status: 204 len: 168 time: 0.4194684 Aug 24 03:08:57.109772 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41654) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:57.110169 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-52154dde-a279-4bbe-ac5c-2010794c7242 req-e988943f-d342-4d3e-9219-6a2dd7d42c7a tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 945 time: 0.0489442 Aug 24 03:08:57.110263 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0660da6d-631b-42ad-a1a6-1d7fa7a704ab admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4ffb6451-69cb-476e-bc2e-5b6165a067b1,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:57.110356 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c898bb6-bad3-425a-98ef-e218d90c6a06 None None] Network 866d4604-551e-4da3-b89c-967338dbafff requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:08:57.150370 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-52154dde-a279-4bbe-ac5c-2010794c7242 req-6dac2b59-21ae-4197-9c01-560723bb1942 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354750 Aug 24 03:08:57.182776 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.225012 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device a4f138f6-af08-4d87-a100-5579647b168d no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:08:57.245773 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Deleting port c3dce199-252c-46ff-8b13-b023698467be {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:08:57.246541 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.260406 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: a4f138f6-af08-4d87-a100-5579647b168d {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:08:57.260741 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device a4f138f6-af08-4d87-a100-5579647b168d not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:08:57.261158 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:08:57.289926 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:08:57.290284 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 2a166f3b-bb0b-4491-b944-aa2b23edd1b6 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:08:57.317197 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] For port c3dce199-252c-46ff-8b13-b023698467be, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=c3dce199-252c-46ff-8b13-b023698467be,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:57.317692 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.332848 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Calling delete_port for c3dce199-252c-46ff-8b13-b023698467be owned by network:dhcp {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:08:57.368433 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bed5a523-ba03-4bb5-b029-87afd3d997d2 None None] DHCP port deletion for 866d4604-551e-4da3-b89c-967338dbafff request from dv-cinder-803748-8-iscsi {{(pid=111277) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Aug 24 03:08:57.417320 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-bed5a523-ba03-4bb5-b029-87afd3d997d2 None None] Deleting port c3dce199-252c-46ff-8b13-b023698467be {{(pid=111277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:08:57.417724 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-bed5a523-ba03-4bb5-b029-87afd3d997d2 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.474494 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.480527 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-bed5a523-ba03-4bb5-b029-87afd3d997d2 None None] For port c3dce199-252c-46ff-8b13-b023698467be, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=c3dce199-252c-46ff-8b13-b023698467be,segment=NetworkSegment(63d10721-d1ef-4dcf-aa60-b159fdfbd4fb),segment_id=63d10721-d1ef-4dcf-aa60-b159fdfbd4fb)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:57.481215 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-bed5a523-ba03-4bb5-b029-87afd3d997d2 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.494452 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-bed5a523-ba03-4bb5-b029-87afd3d997d2 None None] Calling delete_port for c3dce199-252c-46ff-8b13-b023698467be owned by network:dhcp {{(pid=111277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:08:57.501397 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Pushing event deleted for resources: {'Port': ['ID=c3dce199-252c-46ff-8b13-b023698467be,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:57.503290 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] No DVR routers for this DVR port c3dce199-252c-46ff-8b13-b023698467be on host dv-cinder-803748-8-iscsi {{(pid=111275) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:08:57.513443 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3344a25-e390-47db-9e2f-ed1aa426a051 req-c708b261-3f2b-4846-8f7c-245eea0c44a3 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:57.514967 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a3344a25-e390-47db-9e2f-ed1aa426a051 req-c708b261-3f2b-4846-8f7c-245eea0c44a3 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 945 time: 0.0519273 Aug 24 03:08:57.555527 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a3344a25-e390-47db-9e2f-ed1aa426a051 req-19e3080c-386f-483c-9a95-800a8354ef40 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330300 Aug 24 03:08:57.567433 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:08:57.587073 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.588825 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-bed5a523-ba03-4bb5-b029-87afd3d997d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054'] for port, after_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.598156 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['866d4604-551e-4da3-b89c-967338dbafff']}} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:57.609186 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb') {'for_net_delete': True} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:57.609475 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '63d10721-d1ef-4dcf-aa60-b159fdfbd4fb') {} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:57.614926 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bed5a523-ba03-4bb5-b029-87afd3d997d2 None None] Pushing event deleted for resources: {'Port': ['ID=c3dce199-252c-46ff-8b13-b023698467be,revision_number=None']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:57.622729 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bed5a523-ba03-4bb5-b029-87afd3d997d2 None None] No DVR routers for this DVR port c3dce199-252c-46ff-8b13-b023698467be on host dv-cinder-803748-8-iscsi {{(pid=111277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:08:57.624485 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25719248'] for segment, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.644967 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.651248 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Releasing vlan 375 on physical network physnet1 to pool {{(pid=111275) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:08:57.651650 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3484247'] for segment, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: Traceback (most recent call last): Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: timer() Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: cb(*args, **kw) Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: return func(*args, **kwargs) Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: self._notify() Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: self.callback(batched_events) Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: event.method(event) Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: return f(self, *a, **k) Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._get(url).json() Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: return self.request(url, 'GET', **kwargs) Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:08:57.653383 dv-cinder-803748-8-iscsi neutron-server[111275]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:08:57.803076 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.811238 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:57.815184 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] 10.222.0.30 "DELETE /v2.0/networks/866d4604-551e-4da3-b89c-967338dbafff HTTP/1.1" status: 204 len: 168 time: 0.7056215 Aug 24 03:08:57.816423 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41662) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:57.822645 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-070c43e9-22d7-4154-8d28-b5753b1b3ede admin admin] Pushing event deleted for resources: {'Network': ['ID=866d4604-551e-4da3-b89c-967338dbafff,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:58.123650 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91e6b5e9-6c56-4e78-adb4-013e0aa7550a req-b6e934ff-d514-4c0e-a45f-70de8d0468ab tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:58.125129 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-91e6b5e9-6c56-4e78-adb4-013e0aa7550a req-b6e934ff-d514-4c0e-a45f-70de8d0468ab tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 943 time: 0.0508113 Aug 24 03:08:58.163948 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-91e6b5e9-6c56-4e78-adb4-013e0aa7550a req-9a78f14a-9213-4993-b4bf-45fa09c92369 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325587 Aug 24 03:08:58.227302 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f2a4d90-4564-4bd6-bd27-d5f235208d68 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-566649'] for router_interface, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:58.520188 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-2f2a4d90-4564-4bd6-bd27-d5f235208d68 admin admin] Deleting port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:08:58.520532 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f2a4d90-4564-4bd6-bd27-d5f235208d68 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:58.606535 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [None req-2f2a4d90-4564-4bd6-bd27-d5f235208d68 admin admin] For port da408c70-a5b7-41ab-b17e-9b4b0a3b8efd, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=da408c70-a5b7-41ab-b17e-9b4b0a3b8efd,segment=NetworkSegment(492b5e01-c065-4d57-ac35-a87a91acff96),segment_id=492b5e01-c065-4d57-ac35-a87a91acff96)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:58.606951 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f2a4d90-4564-4bd6-bd27-d5f235208d68 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:58.618410 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-2f2a4d90-4564-4bd6-bd27-d5f235208d68 admin admin] Calling delete_port for da408c70-a5b7-41ab-b17e-9b4b0a3b8efd owned by network:router_interface {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:08:58.865990 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f2a4d90-4564-4bd6-bd27-d5f235208d68 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:58.891112 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f2a4d90-4564-4bd6-bd27-d5f235208d68 admin admin] Pushing event deleted for resources: {'Port': ['ID=da408c70-a5b7-41ab-b17e-9b4b0a3b8efd,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:08:59.060547 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-2f2a4d90-4564-4bd6-bd27-d5f235208d68 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-748285', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-566109'] for router_interface, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:59.242297 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device c3dce199-252c-46ff-8b13-b023698467be no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:08:59.264218 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: c3dce199-252c-46ff-8b13-b023698467be {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:08:59.264565 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device c3dce199-252c-46ff-8b13-b023698467be not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:08:59.441403 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc12f70e-407e-4299-be4f-11798acced1e req-7ac799aa-671c-4683-92d3-48f87dc9b1c2 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:08:59.442781 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fc12f70e-407e-4299-be4f-11798acced1e req-7ac799aa-671c-4683-92d3-48f87dc9b1c2 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 943 time: 0.0958529 Aug 24 03:08:59.523969 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-fc12f70e-407e-4299-be4f-11798acced1e req-9472fa4e-a113-4995-b6b1-d756c38eff0e tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736210 Aug 24 03:08:59.582099 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2f2a4d90-4564-4bd6-bd27-d5f235208d68 admin admin] Router aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:08:59.690757 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f2a4d90-4564-4bd6-bd27-d5f235208d68 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:08:59.698722 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-2f2a4d90-4564-4bd6-bd27-d5f235208d68 admin admin] 10.222.0.30 "PUT /v2.0/routers/aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8789437 Aug 24 03:08:59.701155 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41680) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:08:59.702854 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c80b808-3968-4d3d-a26f-24d8d6a60aff None None] Sync routers for ids ['aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:08:59.712718 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c80b808-3968-4d3d-a26f-24d8d6a60aff None None] Routers {'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:08:59.713750 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-0c80b808-3968-4d3d-a26f-24d8d6a60aff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:08:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:08:59.809034 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Notify callbacks [] for router, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:59.820218 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 7819f603-cd75-4d4d-953d-fe791a928097 details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:08:59.821594 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-0c80b808-3968-4d3d-a26f-24d8d6a60aff None None] Set router aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:08:59.916032 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:59.930569 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 7819f603-cd75-4d4d-953d-fe791a928097, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=7819f603-cd75-4d4d-953d-fe791a928097,segment=NetworkSegment(ee1686bb-3a57-460c-84bb-9999e3dc5965),segment_id=ee1686bb-3a57-460c-84bb-9999e3dc5965)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:08:59.940908 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': '7819f603-cd75-4d4d-953d-fe791a928097', 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f', 'port_id': '7819f603-cd75-4d4d-953d-fe791a928097', 'mac_address': 'fa:16:3e:64:8d:4e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 380, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '627c2f10-e51d-47e0-a5a8-56279d49e835', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:08:59.981092 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:08:59.994066 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7819f603-cd75-4d4d-953d-fe791a928097 {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:09:00.000309 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-0c80b808-3968-4d3d-a26f-24d8d6a60aff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'name': 'tempest-TestShelveInstance-509275593-router', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92'}], 'enable_snat': True}, 'gw_port_id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:08:58Z', 'revision_number': 5, 'project_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'gw_port': {'id': 'f0e6a540-50a9-4d61-83d7-75392acbd6c0', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:cb:3e:8a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.92', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:03:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:00.013894 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 7819f603-cd75-4d4d-953d-fe791a928097, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=7819f603-cd75-4d4d-953d-fe791a928097,segment=NetworkSegment(ee1686bb-3a57-460c-84bb-9999e3dc5965),segment_id=ee1686bb-3a57-460c-84bb-9999e3dc5965)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:09:00.030061 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c80b808-3968-4d3d-a26f-24d8d6a60aff None None] Checking router: aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:09:00.038193 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c80b808-3968-4d3d-a26f-24d8d6a60aff None None] Routers {'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:09:00.038797 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-0c80b808-3968-4d3d-a26f-24d8d6a60aff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:08:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:00.081603 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Deleting port f0e6a540-50a9-4d61-83d7-75392acbd6c0 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:09:00.082190 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:00.123931 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-0c80b808-3968-4d3d-a26f-24d8d6a60aff None None] Set router aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c gateway port host: None {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:09:00.134301 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:00.167564 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] For port f0e6a540-50a9-4d61-83d7-75392acbd6c0, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=f0e6a540-50a9-4d61-83d7-75392acbd6c0,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:09:00.168256 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:00.176919 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-0c80b808-3968-4d3d-a26f-24d8d6a60aff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'name': 'tempest-TestShelveInstance-509275593-router', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:08:59Z', 'revision_number': 6, 'project_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'gw_port_host': None}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:00.181481 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Calling delete_port for f0e6a540-50a9-4d61-83d7-75392acbd6c0 owned by network:router_gateway {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:09:00.184667 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=7819f603-cd75-4d4d-953d-fe791a928097,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:00.208862 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c80b808-3968-4d3d-a26f-24d8d6a60aff None None] The sync data for ids ['aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c'] in dv-cinder-803748-8-iscsi is: [{'id': 'aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c', 'name': 'tempest-TestShelveInstance-509275593-router', 'tenant_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:03:42Z', 'updated_at': '2021-08-24T03:08:59Z', 'revision_number': 6, 'project_id': 'bfa136bdac864b3c8042aade77cf7ef3', 'gw_port_host': None}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:09:00.367537 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['7819f603-cd75-4d4d-953d-fe791a928097'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:09:00.505892 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:00.533039 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Pushing event deleted for resources: {'Port': ['ID=f0e6a540-50a9-4d61-83d7-75392acbd6c0,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:00.595599 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-569567'] for router_gateway, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:00.661370 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d77e47-c7f7-4904-bed9-74c49222f936 req-5d5b6f93-85a2-4a24-8567-e4b6f2325a2a tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:00.663290 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-63d77e47-c7f7-4904-bed9-74c49222f936 req-5d5b6f93-85a2-4a24-8567-e4b6f2325a2a tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 944 time: 0.0668159 Aug 24 03:09:00.696199 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-560207', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32699'] for router, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:00.698391 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:00.712547 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-63d77e47-c7f7-4904-bed9-74c49222f936 req-2a594636-3fb1-4bdc-8c40-d0e732238ecc tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404484 Aug 24 03:09:00.862719 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557756'] for router, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:00.863290 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Fanout notify agent at l3_agent the message router_deleted on router aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c {{(pid=111275) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Aug 24 03:09:00.867989 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] Notify callbacks [] for router, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:00.869182 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-63be67bc-29ba-4469-93e6-8a678038c04a admin admin] 10.222.0.30 "DELETE /v2.0/routers/aa23a42f-b51e-4b01-b02d-ebcae3d0fb1c HTTP/1.1" status: 204 len: 168 time: 1.1670091 Aug 24 03:09:00.871858 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41694) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:00.916604 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-64065b2a-9e5d-4743-bd6c-449f55d9060c admin admin] Deleting subnet 590a81da-5183-4161-b5dd-71e21ddf0164 {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:09:00.920447 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-64065b2a-9e5d-4743-bd6c-449f55d9060c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:00.955223 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-64065b2a-9e5d-4743-bd6c-449f55d9060c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.037816 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-64065b2a-9e5d-4743-bd6c-449f55d9060c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.192383 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device da408c70-a5b7-41ab-b17e-9b4b0a3b8efd no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:09:01.208910 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: da408c70-a5b7-41ab-b17e-9b4b0a3b8efd {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:09:01.209263 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device da408c70-a5b7-41ab-b17e-9b4b0a3b8efd not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:09:01.209705 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device f0e6a540-50a9-4d61-83d7-75392acbd6c0 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:09:01.212155 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-64065b2a-9e5d-4743-bd6c-449f55d9060c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.235384 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da971342-caf3-46ee-8b33-9ad0cd2524f3 None None] Network 9cc245d7-39fd-4044-afad-289d6b54b8df requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:09:01.237834 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: f0e6a540-50a9-4d61-83d7-75392acbd6c0 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:09:01.238213 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device f0e6a540-50a9-4d61-83d7-75392acbd6c0 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:09:01.242099 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-64065b2a-9e5d-4743-bd6c-449f55d9060c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.243512 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-64065b2a-9e5d-4743-bd6c-449f55d9060c admin admin] 10.222.0.30 "DELETE /v2.0/subnets/590a81da-5183-4161-b5dd-71e21ddf0164 HTTP/1.1" status: 204 len: 168 time: 0.3707423 Aug 24 03:09:01.244468 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64065b2a-9e5d-4743-bd6c-449f55d9060c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=590a81da-5183-4161-b5dd-71e21ddf0164,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:01.246474 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41696) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:01.324415 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.377137 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Deleting port 973a85b5-51a5-496d-97a0-dbf1b5b101fc {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:09:01.377480 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.410977 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-040c86a5-4ac0-40f1-a25f-a3eafe5a0077 None None] DHCP port deletion for 9cc245d7-39fd-4044-afad-289d6b54b8df request from dv-cinder-803748-8-iscsi {{(pid=111277) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Aug 24 03:09:01.447780 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] For port 973a85b5-51a5-496d-97a0-dbf1b5b101fc, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=973a85b5-51a5-496d-97a0-dbf1b5b101fc,segment=NetworkSegment(492b5e01-c065-4d57-ac35-a87a91acff96),segment_id=492b5e01-c065-4d57-ac35-a87a91acff96)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:09:01.448154 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.455963 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-040c86a5-4ac0-40f1-a25f-a3eafe5a0077 None None] Deleting port 973a85b5-51a5-496d-97a0-dbf1b5b101fc {{(pid=111277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:09:01.456343 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-040c86a5-4ac0-40f1-a25f-a3eafe5a0077 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.461478 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Calling delete_port for 973a85b5-51a5-496d-97a0-dbf1b5b101fc owned by network:dhcp {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:09:01.522252 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-040c86a5-4ac0-40f1-a25f-a3eafe5a0077 None None] For port 973a85b5-51a5-496d-97a0-dbf1b5b101fc, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=973a85b5-51a5-496d-97a0-dbf1b5b101fc,segment=NetworkSegment(492b5e01-c065-4d57-ac35-a87a91acff96),segment_id=492b5e01-c065-4d57-ac35-a87a91acff96)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:09:01.522645 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-040c86a5-4ac0-40f1-a25f-a3eafe5a0077 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.534959 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-040c86a5-4ac0-40f1-a25f-a3eafe5a0077 None None] Calling delete_port for 973a85b5-51a5-496d-97a0-dbf1b5b101fc owned by network:dhcp {{(pid=111277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:09:01.634200 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.640824 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-040c86a5-4ac0-40f1-a25f-a3eafe5a0077 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054'] for port, after_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.660676 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Pushing event deleted for resources: {'Port': ['ID=973a85b5-51a5-496d-97a0-dbf1b5b101fc,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:01.668802 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] No DVR routers for this DVR port 973a85b5-51a5-496d-97a0-dbf1b5b101fc on host dv-cinder-803748-8-iscsi {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:09:01.670684 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040c86a5-4ac0-40f1-a25f-a3eafe5a0077 None None] Pushing event deleted for resources: {'Port': ['ID=973a85b5-51a5-496d-97a0-dbf1b5b101fc,revision_number=None']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:01.672494 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-040c86a5-4ac0-40f1-a25f-a3eafe5a0077 None None] No DVR routers for this DVR port 973a85b5-51a5-496d-97a0-dbf1b5b101fc on host dv-cinder-803748-8-iscsi {{(pid=111277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:09:01.740471 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.751328 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9cc245d7-39fd-4044-afad-289d6b54b8df']}} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:01.763560 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '492b5e01-c065-4d57-ac35-a87a91acff96') {'for_net_delete': True} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:01.764066 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '492b5e01-c065-4d57-ac35-a87a91acff96') {} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:01.773678 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25761368'] for segment, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.793450 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.799450 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Releasing vlan 379 on physical network physnet1 to pool {{(pid=111276) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:09:01.799837 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3525699'] for segment, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: Traceback (most recent call last): Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: timer() Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: cb(*args, **kw) Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: return func(*args, **kwargs) Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: self._notify() Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: self.callback(batched_events) Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: event.method(event) Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: return f(self, *a, **k) Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._get(url).json() Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: return self.request(url, 'GET', **kwargs) Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:09:01.801436 dv-cinder-803748-8-iscsi neutron-server[111276]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:09:01.832093 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 7819f603-cd75-4d4d-953d-fe791a928097 up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:09:01.845520 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b325122-bf0c-455e-b673-181a1995ef39 req-0b2ff022-34d0-4350-a0b8-d2f349f2c525 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:01.850042 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3b325122-bf0c-455e-b673-181a1995ef39 req-0b2ff022-34d0-4350-a0b8-d2f349f2c525 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 944 time: 0.0529337 Aug 24 03:09:01.885339 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3b325122-bf0c-455e-b673-181a1995ef39 req-4846b601-2cf9-4966-9a93-a97990a9632f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323241 Aug 24 03:09:01.936873 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.943219 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:01.945076 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] 10.222.0.30 "DELETE /v2.0/networks/9cc245d7-39fd-4044-afad-289d6b54b8df HTTP/1.1" status: 204 len: 168 time: 0.6956508 Aug 24 03:09:01.955765 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c6d609-c8f2-407a-ba7d-0af6978f28df admin admin] Pushing event deleted for resources: {'Network': ['ID=9cc245d7-39fd-4044-afad-289d6b54b8df,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:01.982564 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port 7819f603-cd75-4d4d-953d-fe791a928097 completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:09:01.986489 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port 7819f603-cd75-4d4d-953d-fe791a928097 triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:09:01.986888 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:02.063000 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:02.084088 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '32bb6e13-dd0a-423c-96d5-64b73513966a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7819f603-cd75-4d4d-953d-fe791a928097'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:09:02.086327 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5778e096-7d76-4847-bf06-0508ae41aff4" -d '{"events": [{"server_uuid": "32bb6e13-dd0a-423c-96d5-64b73513966a", "name": "network-vif-plugged", "status": "completed", "tag": "7819f603-cd75-4d4d-953d-fe791a928097"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:09:02.099305 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port 7819f603-cd75-4d4d-953d-fe791a928097, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=7819f603-cd75-4d4d-953d-fe791a928097,segment=NetworkSegment(ee1686bb-3a57-460c-84bb-9999e3dc5965),segment_id=ee1686bb-3a57-460c-84bb-9999e3dc5965)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:09:02.122573 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:09:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-77c1573e-32cb-473a-a039-c5fd6d24578a x-openstack-request-id: req-77c1573e-32cb-473a-a039-c5fd6d24578a {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:09:02.122869 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "32bb6e13-dd0a-423c-96d5-64b73513966a", "name": "network-vif-plugged", "status": "completed", "tag": "7819f603-cd75-4d4d-953d-fe791a928097", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:09:02.123131 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-77c1573e-32cb-473a-a039-c5fd6d24578a {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:09:02.123965 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '32bb6e13-dd0a-423c-96d5-64b73513966a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7819f603-cd75-4d4d-953d-fe791a928097', 'code': 200} Aug 24 03:09:02.213943 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:02.265560 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=7819f603-cd75-4d4d-953d-fe791a928097,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:02.332484 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41706) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:02.376393 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-84841575-b0f7-405b-9d5f-18dc86bbdb6b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=8bca2ab0549a4f099c2421571c26f61b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0427790 Aug 24 03:09:02.378852 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41708) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:02.450091 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-db9e3803-a92e-438e-ac3e-5333ed87683d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:02.477332 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-db9e3803-a92e-438e-ac3e-5333ed87683d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:02.485264 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f17e26-6d9d-4a40-be7d-2027774471bb req-973ba2ac-c9ab-41f1-ade3-df2712058de5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:02.486745 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a8f17e26-6d9d-4a40-be7d-2027774471bb req-973ba2ac-c9ab-41f1-ade3-df2712058de5 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 1098 time: 0.0713081 Aug 24 03:09:02.535248 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a8f17e26-6d9d-4a40-be7d-2027774471bb req-87443a03-f2e4-4b50-b68e-34adcfed4c73 service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406139 Aug 24 03:09:02.608135 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-db9e3803-a92e-438e-ac3e-5333ed87683d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:02.610679 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-db9e3803-a92e-438e-ac3e-5333ed87683d admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:02.611767 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-db9e3803-a92e-438e-ac3e-5333ed87683d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/904c6741-697e-451f-9490-97353282f9d2 HTTP/1.1" status: 204 len: 168 time: 0.2319899 Aug 24 03:09:02.619838 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db9e3803-a92e-438e-ac3e-5333ed87683d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=904c6741-697e-451f-9490-97353282f9d2,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:03.006618 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a2e235f-1826-41a8-a51d-c756de1b2a05 req-1fdc341d-1924-4612-aa67-9b4c574c073b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:03.008861 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5a2e235f-1826-41a8-a51d-c756de1b2a05 req-1fdc341d-1924-4612-aa67-9b4c574c073b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 945 time: 0.0540893 Aug 24 03:09:03.047730 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-5a2e235f-1826-41a8-a51d-c756de1b2a05 req-c9a20def-5845-4f58-9c1a-20b99190cfe8 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322142 Aug 24 03:09:03.187399 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 973a85b5-51a5-496d-97a0-dbf1b5b101fc no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:09:03.206895 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: 973a85b5-51a5-496d-97a0-dbf1b5b101fc {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:09:03.207249 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 973a85b5-51a5-496d-97a0-dbf1b5b101fc not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:09:03.303974 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41718) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:03.346661 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-ccbb09a3-ab24-471e-9757-5203eab43b1f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=bfa136bdac864b3c8042aade77cf7ef3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0414081 Aug 24 03:09:03.348973 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41720) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:03.394909 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b2f6eb23-8bb6-4d4f-b04f-906bf5475d37 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:03.415413 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b2f6eb23-8bb6-4d4f-b04f-906bf5475d37 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:03.525881 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b2f6eb23-8bb6-4d4f-b04f-906bf5475d37 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:03.528987 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-b2f6eb23-8bb6-4d4f-b04f-906bf5475d37 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:03.530176 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-b2f6eb23-8bb6-4d4f-b04f-906bf5475d37 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/44c3d589-7fb4-4cbd-9a0d-c590bdd96077 HTTP/1.1" status: 204 len: 168 time: 0.1802971 Aug 24 03:09:03.538098 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2f6eb23-8bb6-4d4f-b04f-906bf5475d37 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44c3d589-7fb4-4cbd-9a0d-c590bdd96077,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:04.167778 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de11628-ea50-484d-b9f9-05519deacbf2 req-ee34ab1b-36d1-4bc6-ae19-52ffb756244e tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:04.169170 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4de11628-ea50-484d-b9f9-05519deacbf2 req-ee34ab1b-36d1-4bc6-ae19-52ffb756244e tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 945 time: 0.0540135 Aug 24 03:09:04.208944 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-4de11628-ea50-484d-b9f9-05519deacbf2 req-4a8c8d46-059c-4d87-a600-cf9adadd3f55 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338244 Aug 24 03:09:05.503161 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082119f0-e95b-460b-b6a2-a2f8a0b17269 req-44c43007-fbfa-41a3-85e2-24634b5b2305 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:05.504616 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-082119f0-e95b-460b-b6a2-a2f8a0b17269 req-44c43007-fbfa-41a3-85e2-24634b5b2305 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 945 time: 0.0495784 Aug 24 03:09:05.541394 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-082119f0-e95b-460b-b6a2-a2f8a0b17269 req-ba9c3b63-61bf-47c6-8817-bfa37833c97c tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309286 Aug 24 03:09:06.655316 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21baa80d-61ad-49b7-9931-c9dbd0e0d29a req-65b4b862-16ad-4e5c-ba22-c52c7088ff31 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:06.656779 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-21baa80d-61ad-49b7-9931-c9dbd0e0d29a req-65b4b862-16ad-4e5c-ba22-c52c7088ff31 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 945 time: 0.0479467 Aug 24 03:09:06.699718 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-21baa80d-61ad-49b7-9931-c9dbd0e0d29a req-f4897fec-8711-4b76-aecf-6015bcf7008f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0370648 Aug 24 03:09:07.091903 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4a84c5b-3c4b-4a58-ae14-9e48a892d708 req-1329a5a7-4e39-4d15-9b01-d0819fd7e841 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:07.093324 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f4a84c5b-3c4b-4a58-ae14-9e48a892d708 req-1329a5a7-4e39-4d15-9b01-d0819fd7e841 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.43 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 945 time: 0.0515881 Aug 24 03:09:07.191292 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-f4a84c5b-3c4b-4a58-ae14-9e48a892d708 req-444d5e9a-6cc9-4ba4-939a-e84fc761cb29 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Deleting port 7819f603-cd75-4d4d-953d-fe791a928097 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:09:07.191626 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-f4a84c5b-3c4b-4a58-ae14-9e48a892d708 req-444d5e9a-6cc9-4ba4-939a-e84fc761cb29 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:07.277154 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-f4a84c5b-3c4b-4a58-ae14-9e48a892d708 req-444d5e9a-6cc9-4ba4-939a-e84fc761cb29 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] For port 7819f603-cd75-4d4d-953d-fe791a928097, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=7819f603-cd75-4d4d-953d-fe791a928097,segment=NetworkSegment(ee1686bb-3a57-460c-84bb-9999e3dc5965),segment_id=ee1686bb-3a57-460c-84bb-9999e3dc5965)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:09:07.277427 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-f4a84c5b-3c4b-4a58-ae14-9e48a892d708 req-444d5e9a-6cc9-4ba4-939a-e84fc761cb29 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:07.289988 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-f4a84c5b-3c4b-4a58-ae14-9e48a892d708 req-444d5e9a-6cc9-4ba4-939a-e84fc761cb29 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Calling delete_port for 7819f603-cd75-4d4d-953d-fe791a928097 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:09:07.488622 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-f4a84c5b-3c4b-4a58-ae14-9e48a892d708 req-444d5e9a-6cc9-4ba4-939a-e84fc761cb29 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:07.500481 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['7819f603-cd75-4d4d-953d-fe791a928097'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:09:07.516115 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-444d5e9a-6cc9-4ba4-939a-e84fc761cb29 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Pushing event deleted for resources: {'Port': ['ID=7819f603-cd75-4d4d-953d-fe791a928097,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:07.559186 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4a84c5b-3c4b-4a58-ae14-9e48a892d708 req-444d5e9a-6cc9-4ba4-939a-e84fc761cb29 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] No DVR routers for this DVR port 7819f603-cd75-4d4d-953d-fe791a928097 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:09:07.561519 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-f4a84c5b-3c4b-4a58-ae14-9e48a892d708 req-444d5e9a-6cc9-4ba4-939a-e84fc761cb29 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:07.563606 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f4a84c5b-3c4b-4a58-ae14-9e48a892d708 req-444d5e9a-6cc9-4ba4-939a-e84fc761cb29 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.43 "DELETE /v2.0/ports/7819f603-cd75-4d4d-953d-fe791a928097 HTTP/1.1" status: 204 len: 173 time: 0.4641135 Aug 24 03:09:07.564029 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '32bb6e13-dd0a-423c-96d5-64b73513966a', 'name': 'network-vif-deleted', 'tag': '7819f603-cd75-4d4d-953d-fe791a928097'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:09:07.566341 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-08a19d88-81e3-4c4b-bc25-fc73ebe12f16" -d '{"events": [{"server_uuid": "32bb6e13-dd0a-423c-96d5-64b73513966a", "name": "network-vif-deleted", "tag": "7819f603-cd75-4d4d-953d-fe791a928097"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:09:07.601958 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:09:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4f8e11a3-6f34-4466-a603-446320cbf6d0 x-openstack-request-id: req-4f8e11a3-6f34-4466-a603-446320cbf6d0 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:09:07.602245 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "32bb6e13-dd0a-423c-96d5-64b73513966a", "name": "network-vif-deleted", "tag": "7819f603-cd75-4d4d-953d-fe791a928097", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:09:07.602497 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-4f8e11a3-6f34-4466-a603-446320cbf6d0 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:09:07.602886 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '32bb6e13-dd0a-423c-96d5-64b73513966a', 'name': 'network-vif-deleted', 'tag': '7819f603-cd75-4d4d-953d-fe791a928097', 'status': 'completed', 'code': 200} Aug 24 03:09:07.793428 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b66abb26-7eb1-4e22-a769-213437368f1d req-4468cb1b-b14f-4d9e-9fd8-bf26fad14c01 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=32bb6e13-dd0a-423c-96d5-64b73513966a HTTP/1.1" status: 200 len: 210 time: 0.0253479 Aug 24 03:09:08.339905 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f0f5887-4383-47c6-9f13-6ab64a9c8c7d req-504fc9ad-cae6-4920-98b0-0ad6e16c36eb tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:08.341688 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7f0f5887-4383-47c6-9f13-6ab64a9c8c7d req-504fc9ad-cae6-4920-98b0-0ad6e16c36eb tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 945 time: 0.0534225 Aug 24 03:09:08.379707 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7f0f5887-4383-47c6-9f13-6ab64a9c8c7d req-fc55be57-f6b0-4340-a7b1-b267fb8dd1e0 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321529 Aug 24 03:09:08.402513 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41762) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:08.632673 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-740b048a-0bb4-493d-96ed-876cf91c6a87 tempest-TestMinimumBasicScenario-2046117616 tempest-TestMinimumBasicScenario-2046117616-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:08.634234 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-740b048a-0bb4-493d-96ed-876cf91c6a87 tempest-TestMinimumBasicScenario-2046117616 tempest-TestMinimumBasicScenario-2046117616-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 1093 time: 0.2304134 Aug 24 03:09:08.638016 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41766) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:08.641676 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Request body: {'floatingip': {'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'port_id': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'fixed_ip_address': '172.20.0.6'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:09:08.657130 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:08.725787 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for floatingip, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:08.821064 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:08.923952 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_common [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Allocated IP 172.27.2.86 (63097abe-4b2c-457b-a244-629c1feb1fe5/f60a18ba-c7c4-4157-8bcb-1157d1d1b732/e6d758d4-f703-4081-b578-7bd457209206) {{(pid=111275) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:09:09.029354 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for port, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:09.102911 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-dc161e4f-d3ef-4095-a2dd-f7a6d379dc6a tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:09.104360 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-dc161e4f-d3ef-4095-a2dd-f7a6d379dc6a tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/networks?id=adbf6887-7b6e-435d-a4f0-ee186fa9ca6f HTTP/1.1" status: 200 len: 808 time: 0.0987582 Aug 24 03:09:09.120017 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-7129ec6a-9149-4bfd-8be8-18a0eb3f63d3 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/quotas/340ed71ecf6140648b1ec802f4c9aacb HTTP/1.1" status: 200 len: 375 time: 0.0088162 Aug 24 03:09:09.143521 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:09.156032 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-be1a884e-e773-44b6-a33a-9fe90688b14a tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=340ed71ecf6140648b1ec802f4c9aacb&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0299773 Aug 24 03:09:09.181561 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Network 63097abe-4b2c-457b-a244-629c1feb1fe5 is already hosted by enough agents. {{(pid=111275) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:09:09.186260 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.base_scheduler [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Resources bound (agent type, host, resource id): {{(pid=111275) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:09:09.189649 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Received port after_create {{(pid=111275) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:09:09.196987 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event updated for resources: {'Port': ['ID=e6d758d4-f703-4081-b578-7bd457209206,revision_number=1']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:09.248401 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-d5e56738-0b86-4496-803d-6eef011406c4 service neutron] 10.222.0.30 "GET /v2.0/networks/adbf6887-7b6e-435d-a4f0-ee186fa9ca6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849595 Aug 24 03:09:09.342420 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-89d9b4f1-6b56-45b1-84e3-45450da54436 service neutron] 10.222.0.30 "GET /v2.0/networks/adbf6887-7b6e-435d-a4f0-ee186fa9ca6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0879586 Aug 24 03:09:09.554696 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for floatingip, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:09.634981 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-10798e1b-e4a2-4aec-a07a-42e05baf5c99 req-c4efc804-49f4-414d-8bd8-e9935c47caad tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 210 time: 0.0255787 Aug 24 03:09:09.690861 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:09.840046 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for port, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:09.916339 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3484283'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:09.991466 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event updated for resources: {'Port': ['ID=e6d758d4-f703-4081-b578-7bd457209206,revision_number=2']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:10.000714 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-569381'] for floatingip, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:10.100411 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.l3_db [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Floating IP bfa11141-0b33-4f99-8199-2e2cbe8e8b7f associated. External IP: 172.27.2.86, port: c163baa9-83ec-4da5-a79e-088fea86e5c9. Aug 24 03:09:10.298206 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:09:10.647428 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:09:10.660091 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87795425-2b96-445c-8f4e-ac928becb018 None None] Sync routers for ids ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:09:10.669045 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87795425-2b96-445c-8f4e-ac928becb018 None None] Routers {'e1d42a7b-c203-472f-94cb-e31f4ffab5c6'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:09:10.671084 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-87795425-2b96-445c-8f4e-ac928becb018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:08:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:10.730257 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5fe4df9d-54da-45d0-83bd-040bc169155a req-0c38fbf1-9957-4d54-b227-8d017dd69e5b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 210 time: 0.0265958 Aug 24 03:09:10.745160 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:10.785791 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-91256ae1-01a3-4bfe-94bb-418621c0f9ec tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.1373067 Aug 24 03:09:10.785791 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:09:10.786093 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 41794) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:10.786195 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d459ab13-cf52-4108-858e-b10eae4f3bd9" -d '{"events": [{"name": "network-changed", "server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:09:10.786329 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [None req-49cee7cf-ce66-4505-bdf8-4d607bb96073 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1620221756', 'description': 'tempest-secgroup-smoke-1620221756 description', 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:09:10.786433 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-87795425-2b96-445c-8f4e-ac928becb018 None None] Set router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:09:10.818230 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:09:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cca0082d-964b-440c-a0f8-70834c796754 x-openstack-request-id: req-cca0082d-964b-440c-a0f8-70834c796754 {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:09:10.818520 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:09:10.818773 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cca0082d-964b-440c-a0f8-70834c796754 {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:09:10.819163 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'status': 'completed', 'code': 200} Aug 24 03:09:10.899558 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d459ab13-cf52-4108-858e-b10eae4f3bd9 req-7a82b34b-ae7d-468f-bb36-883f117256a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:10.901049 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d459ab13-cf52-4108-858e-b10eae4f3bd9 req-7a82b34b-ae7d-468f-bb36-883f117256a1 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=a74f1fd1896c4ed09ff280398fa2440f&device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 1098 time: 0.0503328 Aug 24 03:09:10.959101 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-49cee7cf-ce66-4505-bdf8-4d607bb96073 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:11.024070 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-87795425-2b96-445c-8f4e-ac928becb018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 4, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'bfa11141-0b33-4f99-8199-2e2cbe8e8b7f', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'floating_ip_address': '172.27.2.86', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'port_id': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'mac_address': 'fa:16:3e:6a:37:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e65125-3e9f-477e-93cc-b0762249f60d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:09:09Z', 'updated_at': '2021-08-24T03:09:09Z', 'revision_number': 0, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ed6e0056-5b12-4208-94e0-7ff36c2102a7', 'name': '', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'mac_address': 'fa:16:3e:97:c7:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_interface', 'standard_attr_id': 641, 'fixed_ips': [{'subnet_id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:10Z', 'updated_at': '2021-08-24T03:08:16Z', 'revision_number': 5, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'subnets': [{'id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:11.025349 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d459ab13-cf52-4108-858e-b10eae4f3bd9 req-d914f7d6-38a1-4811-83f2-c996570fbd60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:11.026872 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d459ab13-cf52-4108-858e-b10eae4f3bd9 req-d914f7d6-38a1-4811-83f2-c996570fbd60 service neutron] 10.222.0.43 "GET /v2.0/networks?id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b HTTP/1.1" status: 200 len: 916 time: 0.1190109 Aug 24 03:09:11.055399 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87795425-2b96-445c-8f4e-ac928becb018 None None] Checking router: e1d42a7b-c203-472f-94cb-e31f4ffab5c6 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:09:11.064700 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87795425-2b96-445c-8f4e-ac928becb018 None None] Routers {'e1d42a7b-c203-472f-94cb-e31f4ffab5c6'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:09:11.065353 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-87795425-2b96-445c-8f4e-ac928becb018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:08:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:11.117002 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d459ab13-cf52-4108-858e-b10eae4f3bd9 req-c8e23437-c77a-4ec5-8de0-7f90dcbb1d9b service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9 HTTP/1.1" status: 200 len: 998 time: 0.0817904 Aug 24 03:09:11.123845 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-49cee7cf-ce66-4505-bdf8-4d607bb96073 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:11.175437 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d459ab13-cf52-4108-858e-b10eae4f3bd9 req-6ad549f3-4019-47a3-91a1-c3fa4f8eac0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:11.177177 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d459ab13-cf52-4108-858e-b10eae4f3bd9 req-6ad549f3-4019-47a3-91a1-c3fa4f8eac0c service neutron] 10.222.0.43 "GET /v2.0/subnets?id=f42fa902-0e1e-4185-b486-54648ea18f14 HTTP/1.1" status: 200 len: 854 time: 0.0521839 Aug 24 03:09:11.220338 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-49cee7cf-ce66-4505-bdf8-4d607bb96073 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:11.249692 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d459ab13-cf52-4108-858e-b10eae4f3bd9 req-c0b7978b-33c0-40b7-a7ed-70f4f7544dd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:11.251176 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d459ab13-cf52-4108-858e-b10eae4f3bd9 req-c0b7978b-33c0-40b7-a7ed-70f4f7544dd9 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0654008 Aug 24 03:09:11.259357 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49cee7cf-ce66-4505-bdf8-4d607bb96073 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ea9c22ab-a6b2-4c54-b7bf-3726f9559967,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:11.301767 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-87795425-2b96-445c-8f4e-ac928becb018 None None] Set router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:09:11.306442 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-49cee7cf-ce66-4505-bdf8-4d607bb96073 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:11.307584 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-49cee7cf-ce66-4505-bdf8-4d607bb96073 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.5278461 Aug 24 03:09:11.311463 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41798) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:11.317966 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-d84d3800-d23e-4324-9878-8270d2aa6a05 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Request body: {'security_group_rule': {'security_group_id': 'ea9c22ab-a6b2-4c54-b7bf-3726f9559967', 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:09:11.350628 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d459ab13-cf52-4108-858e-b10eae4f3bd9 req-9e9ea0c8-711d-4f7a-bca2-7ee777a4c3cd service neutron] 10.222.0.43 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886958 Aug 24 03:09:11.430961 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d84d3800-d23e-4324-9878-8270d2aa6a05 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:11.455137 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d459ab13-cf52-4108-858e-b10eae4f3bd9 req-9577da52-0a3f-4753-a8f8-ad4a970bde0b service neutron] 10.222.0.43 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916114 Aug 24 03:09:11.501940 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d84d3800-d23e-4324-9878-8270d2aa6a05 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:11.538256 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-87795425-2b96-445c-8f4e-ac928becb018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 4, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'bfa11141-0b33-4f99-8199-2e2cbe8e8b7f', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'floating_ip_address': '172.27.2.86', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'port_id': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'mac_address': 'fa:16:3e:6a:37:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e65125-3e9f-477e-93cc-b0762249f60d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:09:09Z', 'updated_at': '2021-08-24T03:09:09Z', 'revision_number': 0, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ed6e0056-5b12-4208-94e0-7ff36c2102a7', 'name': '', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'mac_address': 'fa:16:3e:97:c7:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_interface', 'standard_attr_id': 641, 'fixed_ips': [{'subnet_id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:10Z', 'updated_at': '2021-08-24T03:08:16Z', 'revision_number': 5, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'subnets': [{'id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:11.571518 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87795425-2b96-445c-8f4e-ac928becb018 None None] The sync data for ids ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'] in dv-cinder-803748-8-iscsi is: [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 4, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'bfa11141-0b33-4f99-8199-2e2cbe8e8b7f', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'floating_ip_address': '172.27.2.86', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'port_id': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'mac_address': 'fa:16:3e:6a:37:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e65125-3e9f-477e-93cc-b0762249f60d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:09:09Z', 'updated_at': '2021-08-24T03:09:09Z', 'revision_number': 0, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ed6e0056-5b12-4208-94e0-7ff36c2102a7', 'name': '', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'mac_address': 'fa:16:3e:97:c7:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_interface', 'standard_attr_id': 641, 'fixed_ips': [{'subnet_id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:10Z', 'updated_at': '2021-08-24T03:08:16Z', 'revision_number': 5, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'subnets': [{'id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:09:11.582814 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d84d3800-d23e-4324-9878-8270d2aa6a05 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:11.603362 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d84d3800-d23e-4324-9878-8270d2aa6a05 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f57ec1a6-8ab6-43e4-86cb-dfa0520e5424,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:11.654280 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-4d101954-8115-41cf-a801-1c49386f51a3 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:11.656067 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-4d101954-8115-41cf-a801-1c49386f51a3 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.43 "GET /v2.0/networks?id=adbf6887-7b6e-435d-a4f0-ee186fa9ca6f HTTP/1.1" status: 200 len: 808 time: 0.1091542 Aug 24 03:09:11.668050 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-d84d3800-d23e-4324-9878-8270d2aa6a05 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:11.669904 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Request body: {'port': {'device_id': 'a6db190a-df01-43f0-9fea-d37ec48b4d31', 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f', 'admin_state_up': True, 'tenant_id': '340ed71ecf6140648b1ec802f4c9aacb'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:09:11.670306 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-d84d3800-d23e-4324-9878-8270d2aa6a05 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3568316 Aug 24 03:09:11.672854 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41800) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:11.677988 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-8bd3d310-600b-4661-a11b-5a901b75783c tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Request body: {'security_group_rule': {'security_group_id': 'ea9c22ab-a6b2-4c54-b7bf-3726f9559967', 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:09:11.774468 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6e974fe-a22b-4a48-adb8-5d61773ee98c None None] New status for floating IP bfa11141-0b33-4f99-8199-2e2cbe8e8b7f: ACTIVE {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:09:11.789416 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8bd3d310-600b-4661-a11b-5a901b75783c tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:11.842551 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-1f5348c4-b0a7-48ab-b1f9-fd1280b812ae req-1e92d6de-e0fb-4a84-9916-7f2f73517471 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 210 time: 0.0275295 Aug 24 03:09:11.856721 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8bd3d310-600b-4661-a11b-5a901b75783c tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:11.892689 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 7819f603-cd75-4d4d-953d-fe791a928097 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:09:11.906229 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Made reservation on behalf of 340ed71ecf6140648b1ec802f4c9aacb for: {'port': 1} {{(pid=111276) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Aug 24 03:09:11.909728 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:11.914701 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 7819f603-cd75-4d4d-953d-fe791a928097 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:09:11.914701 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 7819f603-cd75-4d4d-953d-fe791a928097 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:09:11.962441 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8bd3d310-600b-4661-a11b-5a901b75783c tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:11.980787 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bd3d310-600b-4661-a11b-5a901b75783c tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=70e39fe8-fc90-46f3-9762-ff1b6a01c1b5,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:12.049068 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.db_base_plugin_common [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Allocated IP 172.20.0.3 (adbf6887-7b6e-435d-a4f0-ee186fa9ca6f/627c2f10-e51d-47e0-a5a8-56279d49e835/f78412b9-105d-47e9-8444-ce7bf4a1a56f) {{(pid=111276) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Aug 24 03:09:12.065100 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-8bd3d310-600b-4661-a11b-5a901b75783c tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.069792 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-8bd3d310-600b-4661-a11b-5a901b75783c tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3926311 Aug 24 03:09:12.069792 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41808) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:12.073701 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-a8e5f3d0-71ac-4cfd-8c2a-d2730c91e185 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Request body: {'security_group_rule': {'security_group_id': 'ea9c22ab-a6b2-4c54-b7bf-3726f9559967', 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:09:12.172791 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8e5f3d0-71ac-4cfd-8c2a-d2730c91e185 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.193275 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks [] for port, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.231722 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8e5f3d0-71ac-4cfd-8c2a-d2730c91e185 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.340112 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732363811045', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.368180 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8e5f3d0-71ac-4cfd-8c2a-d2730c91e185 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.381377 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f is already hosted by enough agents. {{(pid=111276) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Aug 24 03:09:12.384281 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.base_scheduler [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Resources bound (agent type, host, resource id): {{(pid=111276) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Aug 24 03:09:12.388569 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Received port after_create {{(pid=111276) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Aug 24 03:09:12.391099 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e5f3d0-71ac-4cfd-8c2a-d2730c91e185 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cdc8ccd9-b05d-4d50-be06-f1c85396ab50,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:12.401565 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Pushing event updated for resources: {'Port': ['ID=f78412b9-105d-47e9-8444-ce7bf4a1a56f,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:12.443012 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:12.443541 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.471020 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a8e5f3d0-71ac-4cfd-8c2a-d2730c91e185 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.472386 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a8e5f3d0-71ac-4cfd-8c2a-d2730c91e185 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4022474 Aug 24 03:09:12.475124 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41810) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:12.479668 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-9d59b9e0-1d78-4a76-a043-b67ca12794cf tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Request body: {'security_group_rule': {'security_group_id': 'ea9c22ab-a6b2-4c54-b7bf-3726f9559967', 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:09:12.548765 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-87fddcb0-b7a3-4855-9f16-acac8d9cd83b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.43 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8835158 Aug 24 03:09:12.561509 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Request body: {'port': {'device_id': 'a6db190a-df01-43f0-9fea-d37ec48b4d31', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80374'}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:09:12.616330 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.632622 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9d59b9e0-1d78-4a76-a043-b67ca12794cf tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.692568 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9d59b9e0-1d78-4a76-a043-b67ca12794cf tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.756205 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9d59b9e0-1d78-4a76-a043-b67ca12794cf tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.773360 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d59b9e0-1d78-4a76-a043-b67ca12794cf tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6df37e92-b8df-4eab-8caa-ec452348cfdf,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:12.847874 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9d59b9e0-1d78-4a76-a043-b67ca12794cf tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.851674 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-9d59b9e0-1d78-4a76-a043-b67ca12794cf tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3730595 Aug 24 03:09:12.852203 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41812) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:12.857460 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-662dc61b-e506-48da-a20c-eb6e4e7294cb tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Request body: {'security_group_rule': {'security_group_id': 'ea9c22ab-a6b2-4c54-b7bf-3726f9559967', 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:09:12.876628 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f78412b9-105d-47e9-8444-ce7bf4a1a56f {{(pid=111276) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:09:12.884296 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.896447 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.provisioning_blocks [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Transition to ACTIVE for port object f78412b9-105d-47e9-8444-ce7bf4a1a56f will not be triggered until provisioned by entity L2. {{(pid=111276) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Aug 24 03:09:12.956747 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.securitygroups_db [None req-662dc61b-e506-48da-a20c-eb6e4e7294cb tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Project a74f1fd1896c4ed09ff280398fa2440f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Aug 24 03:09:12.963926 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-662dc61b-e506-48da-a20c-eb6e4e7294cb tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:12.980160 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfce7f8a-9673-41ba-aae2-42ebafd8f667 req-7c5f61d0-6b3f-4434-8c43-1e2f4431d643 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:12.982305 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-cfce7f8a-9673-41ba-aae2-42ebafd8f667 req-7c5f61d0-6b3f-4434-8c43-1e2f4431d643 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 931 time: 0.0619183 Aug 24 03:09:13.008179 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:13.053566 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-cfce7f8a-9673-41ba-aae2-42ebafd8f667 req-3be5c4ba-e14b-40dc-903a-617bd5da3c1d tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614409 Aug 24 03:09:13.057698 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Pushing event updated for resources: {'Port': ['ID=f78412b9-105d-47e9-8444-ce7bf4a1a56f,revision_number=2']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:13.063806 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-662dc61b-e506-48da-a20c-eb6e4e7294cb tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:13.129474 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Attempting to bind port f78412b9-105d-47e9-8444-ce7bf4a1a56f on host hv-cinder-80374 for vnic_type normal with profile {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Aug 24 03:09:13.129832 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Attempting to bind port f78412b9-105d-47e9-8444-ce7bf4a1a56f by drivers openvswitch,hyperv on host hv-cinder-80374 at level 0 using segments [{'id': 'ee1686bb-3a57-460c-84bb-9999e3dc5965', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f'}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Aug 24 03:09:13.130160 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Attempting to bind port f78412b9-105d-47e9-8444-ce7bf4a1a56f on network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:09:13.134428 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Port f78412b9-105d-47e9-8444-ce7bf4a1a56f on network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80374 {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Aug 24 03:09:13.134752 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Attempting to bind port f78412b9-105d-47e9-8444-ce7bf4a1a56f on network adbf6887-7b6e-435d-a4f0-ee186fa9ca6f {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Aug 24 03:09:13.139633 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Checking agent: {'id': '7308c288-4981-4950-bffa-26e40a4c0e4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80374', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'started_at': datetime.datetime(2021, 8, 24, 2, 57, 38), 'heartbeat_timestamp': datetime.datetime(2021, 8, 24, 3, 9, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Aug 24 03:09:13.139963 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Checking segment: {'id': 'ee1686bb-3a57-460c-84bb-9999e3dc5965', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=111276) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:352}} Aug 24 03:09:13.140360 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Bound using segment: {'id': 'ee1686bb-3a57-460c-84bb-9999e3dc5965', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f'} {{(pid=111276) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Aug 24 03:09:13.140765 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.managers [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Bound port: f78412b9-105d-47e9-8444-ce7bf4a1a56f, host: hv-cinder-80374, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ee1686bb-3a57-460c-84bb-9999e3dc5965', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 380, 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f'}}] {{(pid=111276) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Aug 24 03:09:13.141118 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:13.191071 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-662dc61b-e506-48da-a20c-eb6e4e7294cb tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:13.207001 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] For port f78412b9-105d-47e9-8444-ce7bf4a1a56f, host hv-cinder-80374, cleared binding levels {{(pid=111276) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Aug 24 03:09:13.210233 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] For port f78412b9-105d-47e9-8444-ce7bf4a1a56f, host hv-cinder-80374, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=f78412b9-105d-47e9-8444-ce7bf4a1a56f,segment=NetworkSegment(ee1686bb-3a57-460c-84bb-9999e3dc5965),segment_id=ee1686bb-3a57-460c-84bb-9999e3dc5965)] {{(pid=111276) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Aug 24 03:09:13.211062 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-662dc61b-e506-48da-a20c-eb6e4e7294cb tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=09eec453-7451-40cf-b3ab-f88902d15264,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:13.316448 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-662dc61b-e506-48da-a20c-eb6e4e7294cb tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:13.317606 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-662dc61b-e506-48da-a20c-eb6e4e7294cb tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4643881 Aug 24 03:09:13.320691 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 41820) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:13.326334 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [None req-fac7c206-9b29-40f1-972d-8a7bb1936c79 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Request body: {'security_group_rule': {'security_group_id': 'ea9c22ab-a6b2-4c54-b7bf-3726f9559967', 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:09:13.331968 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:13.367883 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:13.368499 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:13.369943 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] 10.222.0.43 "PUT /v2.0/ports/f78412b9-105d-47e9-8444-ce7bf4a1a56f HTTP/1.1" status: 200 len: 1093 time: 0.8131988 Aug 24 03:09:13.370370 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a6db190a-df01-43f0-9fea-d37ec48b4d31', 'tag': 'f78412b9-105d-47e9-8444-ce7bf4a1a56f'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:09:13.372697 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b582a2b8-cb05-4269-85ee-9b2bb77be030" -d '{"events": [{"name": "network-changed", "server_uuid": "a6db190a-df01-43f0-9fea-d37ec48b4d31", "tag": "f78412b9-105d-47e9-8444-ce7bf4a1a56f"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:09:13.395127 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6b6a408-1b38-4184-ba5e-f48ca4b801e7 service neutron] Pushing event updated for resources: {'Port': ['ID=f78412b9-105d-47e9-8444-ce7bf4a1a56f,revision_number=3']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:13.412187 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:09:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-520d0cb9-5bd9-4753-a374-324362fc5978 x-openstack-request-id: req-520d0cb9-5bd9-4753-a374-324362fc5978 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:09:13.412519 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a6db190a-df01-43f0-9fea-d37ec48b4d31", "tag": "f78412b9-105d-47e9-8444-ce7bf4a1a56f", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:09:13.412808 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-520d0cb9-5bd9-4753-a374-324362fc5978 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:09:13.413202 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a6db190a-df01-43f0-9fea-d37ec48b4d31', 'tag': 'f78412b9-105d-47e9-8444-ce7bf4a1a56f', 'status': 'completed', 'code': 200} Aug 24 03:09:13.470966 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b582a2b8-cb05-4269-85ee-9b2bb77be030 req-63a2cac1-80c4-4984-9cbc-d44bab4480c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:13.472405 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b582a2b8-cb05-4269-85ee-9b2bb77be030 req-63a2cac1-80c4-4984-9cbc-d44bab4480c4 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=340ed71ecf6140648b1ec802f4c9aacb&device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 1096 time: 0.0405545 Aug 24 03:09:13.497161 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.securitygroups_db [None req-fac7c206-9b29-40f1-972d-8a7bb1936c79 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Project a74f1fd1896c4ed09ff280398fa2440f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Aug 24 03:09:13.502322 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fac7c206-9b29-40f1-972d-8a7bb1936c79 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, before_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:13.566176 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fac7c206-9b29-40f1-972d-8a7bb1936c79 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:13.574956 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b582a2b8-cb05-4269-85ee-9b2bb77be030 req-25ad677c-c1fc-41b3-82dc-a70acc533eb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:13.576394 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b582a2b8-cb05-4269-85ee-9b2bb77be030 req-25ad677c-c1fc-41b3-82dc-a70acc533eb8 service neutron] 10.222.0.43 "GET /v2.0/networks?tenant_id=340ed71ecf6140648b1ec802f4c9aacb&shared=False HTTP/1.1" status: 200 len: 909 time: 0.0960331 Aug 24 03:09:13.640325 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fac7c206-9b29-40f1-972d-8a7bb1936c79 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602920'] for security_group_rule, after_create {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:13.658776 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fac7c206-9b29-40f1-972d-8a7bb1936c79 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=82e5eada-adff-44d7-a7f0-308679170518,revision_number=0']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:13.673765 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b582a2b8-cb05-4269-85ee-9b2bb77be030 req-cc3ac8cb-506c-4a7e-8d2b-5d3c5b672d88 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:13.675212 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b582a2b8-cb05-4269-85ee-9b2bb77be030 req-cc3ac8cb-506c-4a7e-8d2b-5d3c5b672d88 service neutron] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0884967 Aug 24 03:09:13.733849 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-fac7c206-9b29-40f1-972d-8a7bb1936c79 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group_rule, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:13.735073 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-fac7c206-9b29-40f1-972d-8a7bb1936c79 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4134622 Aug 24 03:09:13.758254 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-cd8811f1-6fb1-4cba-964a-ea57f22c686f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:13.759730 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-cd8811f1-6fb1-4cba-964a-ea57f22c686f service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=340ed71ecf6140648b1ec802f4c9aacb&device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 1096 time: 0.0440488 Aug 24 03:09:13.802481 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-1d04785c-6429-4834-8596-5831e7c36de1 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f78412b9-105d-47e9-8444-ce7bf4a1a56f HTTP/1.1" status: 200 len: 217 time: 0.0334702 Aug 24 03:09:13.813124 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-383f7fb8-ffd2-4151-8b1f-cefebba34e43 req-0621cff2-458e-4ac7-b7b2-7f877ff28c6c tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1620221756&fields=id&tenant_id=a74f1fd1896c4ed09ff280398fa2440f HTTP/1.1" status: 200 len: 267 time: 0.0326719 Aug 24 03:09:13.853627 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-83dac0d4-9775-4121-9755-ff9155d30e64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:13.855004 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-83dac0d4-9775-4121-9755-ff9155d30e64 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=627c2f10-e51d-47e0-a5a8-56279d49e835 HTTP/1.1" status: 200 len: 848 time: 0.0443220 Aug 24 03:09:13.865497 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-383f7fb8-ffd2-4151-8b1f-cefebba34e43 req-1bfd4c68-29f0-49e6-bc61-99d81417be67 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:13.866987 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-383f7fb8-ffd2-4151-8b1f-cefebba34e43 req-1bfd4c68-29f0-49e6-bc61-99d81417be67 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 945 time: 0.0480156 Aug 24 03:09:13.879033 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.v2.base [req-383f7fb8-ffd2-4151-8b1f-cefebba34e43 req-623da7ce-9f13-47e4-83cd-8555b9aa9dea tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Request body: {'port': {'security_groups': ['9abe615f-f88c-4d6c-97fa-2384752d2c4b', 'ea9c22ab-a6b2-4c54-b7bf-3726f9559967']}} {{(pid=111275) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:09:13.892976 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-8213b1b8-a1d5-4b50-83a7-003199ec4026 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=adbf6887-7b6e-435d-a4f0-ee186fa9ca6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0294330 Aug 24 03:09:13.945813 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-383f7fb8-ffd2-4151-8b1f-cefebba34e43 req-623da7ce-9f13-47e4-83cd-8555b9aa9dea tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:13.983107 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-e825b649-bd9f-49f5-8ea0-d650cefc9854 service neutron] 10.222.0.43 "GET /v2.0/networks/adbf6887-7b6e-435d-a4f0-ee186fa9ca6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824776 Aug 24 03:09:14.076101 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bae4b6c3-e41a-4a3a-b7c8-3ae8a6baed1b req-bb394825-8de4-49eb-aeed-0dadd77df02d service neutron] 10.222.0.43 "GET /v2.0/networks/adbf6887-7b6e-435d-a4f0-ee186fa9ca6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853894 Aug 24 03:09:14.164427 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [req-383f7fb8-ffd2-4151-8b1f-cefebba34e43 req-623da7ce-9f13-47e4-83cd-8555b9aa9dea tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] For port c163baa9-83ec-4da5-a79e-088fea86e5c9, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:09:14.175430 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29c45856-3029-474e-a3bf-7960870eb10f req-89ff8b5f-6dee-4c01-80f9-b22cbe65507d tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:14.177185 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-29c45856-3029-474e-a3bf-7960870eb10f req-89ff8b5f-6dee-4c01-80f9-b22cbe65507d tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 943 time: 0.0495944 Aug 24 03:09:14.195635 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-383f7fb8-ffd2-4151-8b1f-cefebba34e43 req-623da7ce-9f13-47e4-83cd-8555b9aa9dea tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for port, precommit_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:14.216175 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-29c45856-3029-474e-a3bf-7960870eb10f req-2fcb065a-cfcb-41be-8442-4004bde69a45 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327666 Aug 24 03:09:14.279469 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-383f7fb8-ffd2-4151-8b1f-cefebba34e43 req-623da7ce-9f13-47e4-83cd-8555b9aa9dea tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3484283'] for port, after_update {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:14.323683 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-383f7fb8-ffd2-4151-8b1f-cefebba34e43 req-623da7ce-9f13-47e4-83cd-8555b9aa9dea tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:14.324349 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [req-383f7fb8-ffd2-4151-8b1f-cefebba34e43 req-623da7ce-9f13-47e4-83cd-8555b9aa9dea tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:14.325869 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-383f7fb8-ffd2-4151-8b1f-cefebba34e43 req-623da7ce-9f13-47e4-83cd-8555b9aa9dea tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "PUT /v2.0/ports/c163baa9-83ec-4da5-a79e-088fea86e5c9 HTTP/1.1" status: 200 len: 981 time: 0.4515929 Aug 24 03:09:14.326321 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:09:14.328559 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f62e6dd3-93c8-4257-b0c1-7bab7f374f2f" -d '{"events": [{"name": "network-changed", "server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:09:14.365614 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['c163baa9-83ec-4da5-a79e-088fea86e5c9'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:09:14.374259 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-623da7ce-9f13-47e4-83cd-8555b9aa9dea tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event updated for resources: {'Port': ['ID=c163baa9-83ec-4da5-a79e-088fea86e5c9,revision_number=6']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:14.381654 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:09:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5e56d2df-67ed-471c-9669-7b11f7d412dd x-openstack-request-id: req-5e56d2df-67ed-471c-9669-7b11f7d412dd {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:09:14.381986 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:09:14.382204 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-5e56d2df-67ed-471c-9669-7b11f7d412dd {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:09:14.382616 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'status': 'completed', 'code': 200} Aug 24 03:09:14.470658 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['c163baa9-83ec-4da5-a79e-088fea86e5c9'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:09:14.471713 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-466c4bf7-2fff-4c18-b5af-fd163bb49d14 req-b671a198-fef8-49cc-94e4-a51a20f53bff tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:14.473254 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-466c4bf7-2fff-4c18-b5af-fd163bb49d14 req-b671a198-fef8-49cc-94e4-a51a20f53bff tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.0918996 Aug 24 03:09:14.476117 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f62e6dd3-93c8-4257-b0c1-7bab7f374f2f req-957e78fc-c863-43ec-9a91-c895e581c7a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:14.477499 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f62e6dd3-93c8-4257-b0c1-7bab7f374f2f req-957e78fc-c863-43ec-9a91-c895e581c7a9 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=a74f1fd1896c4ed09ff280398fa2440f&device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 1137 time: 0.0616903 Aug 24 03:09:14.569153 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-466c4bf7-2fff-4c18-b5af-fd163bb49d14 req-c136db41-caad-424a-b87c-eae6281cb65e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0864580 Aug 24 03:09:14.571746 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-e1dd080f-8912-4d4a-8b41-2a1aeffc04be None None] Provisioning complete for port c163baa9-83ec-4da5-a79e-088fea86e5c9 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:09:14.572118 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-e1dd080f-8912-4d4a-8b41-2a1aeffc04be None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:14.610315 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f62e6dd3-93c8-4257-b0c1-7bab7f374f2f req-a7315503-85a5-4801-83e2-379299707f56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:14.611928 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f62e6dd3-93c8-4257-b0c1-7bab7f374f2f req-a7315503-85a5-4801-83e2-379299707f56 service neutron] 10.222.0.43 "GET /v2.0/networks?id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b HTTP/1.1" status: 200 len: 916 time: 0.1221795 Aug 24 03:09:14.683035 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f62e6dd3-93c8-4257-b0c1-7bab7f374f2f req-39ea5cdb-2c99-47c5-8587-197cdc113a22 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9 HTTP/1.1" status: 200 len: 1000 time: 0.0620723 Aug 24 03:09:14.740065 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f62e6dd3-93c8-4257-b0c1-7bab7f374f2f req-091986b2-e08d-4e94-8099-a43f395b5754 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:14.741525 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f62e6dd3-93c8-4257-b0c1-7bab7f374f2f req-091986b2-e08d-4e94-8099-a43f395b5754 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=f42fa902-0e1e-4185-b486-54648ea18f14 HTTP/1.1" status: 200 len: 854 time: 0.0439355 Aug 24 03:09:14.788262 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f62e6dd3-93c8-4257-b0c1-7bab7f374f2f req-b97061b1-6ab6-4db9-b524-9366f11cd6a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:14.789755 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f62e6dd3-93c8-4257-b0c1-7bab7f374f2f req-b97061b1-6ab6-4db9-b524-9366f11cd6a0 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0395830 Aug 24 03:09:14.888226 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f62e6dd3-93c8-4257-b0c1-7bab7f374f2f req-ceeae5cc-4de5-4961-b890-70bccf5360ac service neutron] 10.222.0.43 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0878086 Aug 24 03:09:14.979794 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-f62e6dd3-93c8-4257-b0c1-7bab7f374f2f req-b4a5b00e-9070-4e18-85c4-8816d6b45c5d service neutron] 10.222.0.43 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829453 Aug 24 03:09:15.332916 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dd95dea-54c9-462c-8d63-27e7e871f3ff req-a8e63968-af46-43a0-b45f-21ec14915024 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:15.334456 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7dd95dea-54c9-462c-8d63-27e7e871f3ff req-a8e63968-af46-43a0-b45f-21ec14915024 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 943 time: 0.0518851 Aug 24 03:09:15.372863 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7dd95dea-54c9-462c-8d63-27e7e871f3ff req-c7538821-2f01-428e-bac8-185b0fe16f17 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317659 Aug 24 03:09:16.484204 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cada8bc-dad5-42bd-9e5b-228b16302ef7 req-b0cf9d8f-e8b4-4a06-af60-f7d6b6d9498f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:16.485685 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7cada8bc-dad5-42bd-9e5b-228b16302ef7 req-b0cf9d8f-e8b4-4a06-af60-f7d6b6d9498f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 943 time: 0.0475430 Aug 24 03:09:16.521753 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-7cada8bc-dad5-42bd-9e5b-228b16302ef7 req-3412c5c7-66cc-46cf-8944-90609e3a1121 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0301607 Aug 24 03:09:17.632074 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fda9a64-954f-4679-8ef7-0d100075011d req-500b2193-8f21-4f7d-804a-a2a3d106df76 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:17.633521 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2fda9a64-954f-4679-8ef7-0d100075011d req-500b2193-8f21-4f7d-804a-a2a3d106df76 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 943 time: 0.0468192 Aug 24 03:09:17.670379 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-2fda9a64-954f-4679-8ef7-0d100075011d req-2007814f-368b-44e8-ae3e-a4e501ec0a42 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0303879 Aug 24 03:09:17.900008 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device f78412b9-105d-47e9-8444-ce7bf4a1a56f details requested by agent hyperv_hv-cinder-80374 with host hv-cinder-80374 {{(pid=111277) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Aug 24 03:09:17.992226 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port f78412b9-105d-47e9-8444-ce7bf4a1a56f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=f78412b9-105d-47e9-8444-ce7bf4a1a56f,segment=NetworkSegment(ee1686bb-3a57-460c-84bb-9999e3dc5965),segment_id=ee1686bb-3a57-460c-84bb-9999e3dc5965)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:09:18.003058 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Returning: {'device': 'f78412b9-105d-47e9-8444-ce7bf4a1a56f', 'network_id': 'adbf6887-7b6e-435d-a4f0-ee186fa9ca6f', 'port_id': 'f78412b9-105d-47e9-8444-ce7bf4a1a56f', 'mac_address': 'fa:16:3e:3d:a3:bf', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 380, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '627c2f10-e51d-47e0-a5a8-56279d49e835', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=111277) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Aug 24 03:09:18.042096 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:18.055052 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f78412b9-105d-47e9-8444-ce7bf4a1a56f {{(pid=111277) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Aug 24 03:09:18.073777 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port f78412b9-105d-47e9-8444-ce7bf4a1a56f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=f78412b9-105d-47e9-8444-ce7bf4a1a56f,segment=NetworkSegment(ee1686bb-3a57-460c-84bb-9999e3dc5965),segment_id=ee1686bb-3a57-460c-84bb-9999e3dc5965)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:09:18.150721 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:18.200034 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=f78412b9-105d-47e9-8444-ce7bf4a1a56f,revision_number=4']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:18.207488 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:18.207838 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:18.208182 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:18.208520 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:18.208853 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:18.209204 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:18.209515 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:18.210005 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:18.210336 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:18.210663 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:18.210988 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:18.211312 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:18.390009 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['f78412b9-105d-47e9-8444-ce7bf4a1a56f'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:09:18.786455 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e01a1f8-82b7-46d6-8039-46c507adec46 req-dac4e3a9-8316-4acd-80f3-f2d9835d15b8 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:18.787943 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5e01a1f8-82b7-46d6-8039-46c507adec46 req-dac4e3a9-8316-4acd-80f3-f2d9835d15b8 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 944 time: 0.0514605 Aug 24 03:09:18.825224 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-5e01a1f8-82b7-46d6-8039-46c507adec46 req-7ab57915-2694-42d3-89a1-17fbe443cd3f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314400 Aug 24 03:09:19.906420 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device f78412b9-105d-47e9-8444-ce7bf4a1a56f up at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Aug 24 03:09:19.939481 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-addb5574-bcb6-4d22-8c1c-cec8dade25a9 req-968163a5-77e3-4dd7-b427-6bf13bdc1298 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:19.940932 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-addb5574-bcb6-4d22-8c1c-cec8dade25a9 req-968163a5-77e3-4dd7-b427-6bf13bdc1298 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 944 time: 0.0488131 Aug 24 03:09:19.982247 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-addb5574-bcb6-4d22-8c1c-cec8dade25a9 req-a64f83d6-e569-4b78-b33b-05e50244de24 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347416 Aug 24 03:09:20.011262 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning for port f78412b9-105d-47e9-8444-ce7bf4a1a56f completed by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Aug 24 03:09:20.015913 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Provisioning complete for port f78412b9-105d-47e9-8444-ce7bf4a1a56f triggered by entity L2. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:09:20.016295 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:20.091538 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:20.113018 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a6db190a-df01-43f0-9fea-d37ec48b4d31', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f78412b9-105d-47e9-8444-ce7bf4a1a56f'}] {{(pid=111277) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:09:20.115274 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a671c9bbc50a8cc5f00083dcd201085e7456bd1e070be71cd35b1cef292ab2d7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8f818336-760f-40a9-9058-eba2c3ec4bd0" -d '{"events": [{"server_uuid": "a6db190a-df01-43f0-9fea-d37ec48b4d31", "name": "network-vif-plugged", "status": "completed", "tag": "f78412b9-105d-47e9-8444-ce7bf4a1a56f"}]}' {{(pid=111277) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:09:20.131697 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] For port f78412b9-105d-47e9-8444-ce7bf4a1a56f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=f78412b9-105d-47e9-8444-ce7bf4a1a56f,segment=NetworkSegment(ee1686bb-3a57-460c-84bb-9999e3dc5965),segment_id=ee1686bb-3a57-460c-84bb-9999e3dc5965)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:09:20.150710 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:09:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fad43c2a-f9f5-452f-b36c-887f6ece5f5f x-openstack-request-id: req-fad43c2a-f9f5-452f-b36c-887f6ece5f5f {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:09:20.153137 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a6db190a-df01-43f0-9fea-d37ec48b4d31", "name": "network-vif-plugged", "status": "completed", "tag": "f78412b9-105d-47e9-8444-ce7bf4a1a56f", "code": 200}]} {{(pid=111277) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:09:20.153137 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-fad43c2a-f9f5-452f-b36c-887f6ece5f5f {{(pid=111277) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:09:20.153137 dv-cinder-803748-8-iscsi neutron-server[111277]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a6db190a-df01-43f0-9fea-d37ec48b4d31', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f78412b9-105d-47e9-8444-ce7bf4a1a56f', 'code': 200} Aug 24 03:09:20.231265 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269'] for port, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:20.277744 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Pushing event updated for resources: {'Port': ['ID=f78412b9-105d-47e9-8444-ce7bf4a1a56f,revision_number=5']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:20.504959 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90446a41-78ed-4fba-9d88-4bba09c4a675 req-0180200f-8b89-47f0-b290-82fec3e5a6b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:20.506540 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-90446a41-78ed-4fba-9d88-4bba09c4a675 req-0180200f-8b89-47f0-b290-82fec3e5a6b0 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 1098 time: 0.0397973 Aug 24 03:09:20.540608 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-90446a41-78ed-4fba-9d88-4bba09c4a675 req-b0ae2eb3-7d3d-4aed-aa2e-67effbeaa13e service neutron] 10.222.0.43 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0269601 Aug 24 03:09:21.098628 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e7d212-6bce-4871-8c61-dd4884c3d046 req-05047a48-7032-4d94-a0c2-b3abeb96ca50 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:21.100113 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a0e7d212-6bce-4871-8c61-dd4884c3d046 req-05047a48-7032-4d94-a0c2-b3abeb96ca50 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 945 time: 0.0482681 Aug 24 03:09:21.136410 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a0e7d212-6bce-4871-8c61-dd4884c3d046 req-fceb3d6b-7bba-43d4-adcf-c90a95188c9b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304465 Aug 24 03:09:21.476153 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-a0e22ec0-1adc-4470-994d-3beefbafd9af None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:22.252135 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dd68002-5599-489d-a139-3c094fb6783b req-fb7421f2-ab68-45ce-897a-0dea179b94c4 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:22.253598 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0dd68002-5599-489d-a139-3c094fb6783b req-fb7421f2-ab68-45ce-897a-0dea179b94c4 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 945 time: 0.0492105 Aug 24 03:09:22.289946 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-0dd68002-5599-489d-a139-3c094fb6783b req-6544797c-7338-43b8-8a9b-b9e47d4b0eba tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304654 Aug 24 03:09:23.866935 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014436a6-6116-4806-a8ef-ffd89ab8f467 req-cc1602b5-f7a7-45c8-8201-15f8a808b214 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:23.866935 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-014436a6-6116-4806-a8ef-ffd89ab8f467 req-cc1602b5-f7a7-45c8-8201-15f8a808b214 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 945 time: 0.2989080 Aug 24 03:09:23.902526 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-014436a6-6116-4806-a8ef-ffd89ab8f467 req-9467ed47-4938-4d14-b956-10348672094f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317898 Aug 24 03:09:24.002113 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5f8f74f1-9b2f-44e6-9d1f-21d8423fb5cd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:24.341970 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:24.983048 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6885205f-b3f5-4e14-972c-cc76871713d1 req-0a9c451b-95ad-4f90-8d6e-9aae45c5ff4f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:24.984495 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6885205f-b3f5-4e14-972c-cc76871713d1 req-0a9c451b-95ad-4f90-8d6e-9aae45c5ff4f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.43 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 945 time: 0.0609267 Aug 24 03:09:25.032985 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68afac9f-0792-4d3b-8081-a02cc789a41c req-9000c7c0-6e87-4291-9925-dd71c5bb3dd4 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:25.034918 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-68afac9f-0792-4d3b-8081-a02cc789a41c req-9000c7c0-6e87-4291-9925-dd71c5bb3dd4 tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 945 time: 0.0564451 Aug 24 03:09:25.082474 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-68afac9f-0792-4d3b-8081-a02cc789a41c req-b2fdb323-d1e9-4e53-947c-3dc8567f8f3b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/security-groups?id=1a9da183-f230-46b4-b86f-b6b653e320d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375452 Aug 24 03:09:25.090270 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-6885205f-b3f5-4e14-972c-cc76871713d1 req-56ed66c0-d0a8-4d80-966d-3163bdf0875f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Deleting port f78412b9-105d-47e9-8444-ce7bf4a1a56f {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:09:25.090876 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-6885205f-b3f5-4e14-972c-cc76871713d1 req-56ed66c0-d0a8-4d80-966d-3163bdf0875f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:25.193604 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-6885205f-b3f5-4e14-972c-cc76871713d1 req-56ed66c0-d0a8-4d80-966d-3163bdf0875f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] For port f78412b9-105d-47e9-8444-ce7bf4a1a56f, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=f78412b9-105d-47e9-8444-ce7bf4a1a56f,segment=NetworkSegment(ee1686bb-3a57-460c-84bb-9999e3dc5965),segment_id=ee1686bb-3a57-460c-84bb-9999e3dc5965)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:09:25.193899 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-6885205f-b3f5-4e14-972c-cc76871713d1 req-56ed66c0-d0a8-4d80-966d-3163bdf0875f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:25.206807 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-6885205f-b3f5-4e14-972c-cc76871713d1 req-56ed66c0-d0a8-4d80-966d-3163bdf0875f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Calling delete_port for f78412b9-105d-47e9-8444-ce7bf4a1a56f owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:09:25.411061 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-6885205f-b3f5-4e14-972c-cc76871713d1 req-56ed66c0-d0a8-4d80-966d-3163bdf0875f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:25.424372 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['f78412b9-105d-47e9-8444-ce7bf4a1a56f'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:09:25.439527 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56ed66c0-d0a8-4d80-966d-3163bdf0875f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Pushing event deleted for resources: {'Port': ['ID=f78412b9-105d-47e9-8444-ce7bf4a1a56f,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:25.480377 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-6885205f-b3f5-4e14-972c-cc76871713d1 req-56ed66c0-d0a8-4d80-966d-3163bdf0875f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] No DVR routers for this DVR port f78412b9-105d-47e9-8444-ce7bf4a1a56f on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:09:25.482930 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-6885205f-b3f5-4e14-972c-cc76871713d1 req-56ed66c0-d0a8-4d80-966d-3163bdf0875f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:25.484859 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-6885205f-b3f5-4e14-972c-cc76871713d1 req-56ed66c0-d0a8-4d80-966d-3163bdf0875f tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.43 "DELETE /v2.0/ports/f78412b9-105d-47e9-8444-ce7bf4a1a56f HTTP/1.1" status: 204 len: 173 time: 0.4943321 Aug 24 03:09:25.485284 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a6db190a-df01-43f0-9fea-d37ec48b4d31', 'name': 'network-vif-deleted', 'tag': 'f78412b9-105d-47e9-8444-ce7bf4a1a56f'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:09:25.487590 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c15536c1-956d-41ea-a2d4-3bbdd7c90f82" -d '{"events": [{"server_uuid": "a6db190a-df01-43f0-9fea-d37ec48b4d31", "name": "network-vif-deleted", "tag": "f78412b9-105d-47e9-8444-ce7bf4a1a56f"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:09:25.521405 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:09:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e31d4c97-5fac-4628-a1fb-3d47c2287c43 x-openstack-request-id: req-e31d4c97-5fac-4628-a1fb-3d47c2287c43 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:09:25.521723 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a6db190a-df01-43f0-9fea-d37ec48b4d31", "name": "network-vif-deleted", "tag": "f78412b9-105d-47e9-8444-ce7bf4a1a56f", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:09:25.521971 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e31d4c97-5fac-4628-a1fb-3d47c2287c43 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:09:25.522362 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a6db190a-df01-43f0-9fea-d37ec48b4d31', 'name': 'network-vif-deleted', 'tag': 'f78412b9-105d-47e9-8444-ce7bf4a1a56f', 'status': 'completed', 'code': 200} Aug 24 03:09:25.616749 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:26.190911 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-a1804d37-d860-4285-8571-5a45d10cd369 req-c8568672-c50d-43bf-b0e6-02561e440a3b tempest-VolumesActionsTest-596962983 tempest-VolumesActionsTest-596962983-project] 10.222.0.30 "GET /v2.0/ports?device_id=a6db190a-df01-43f0-9fea-d37ec48b4d31 HTTP/1.1" status: 200 len: 210 time: 0.0268676 Aug 24 03:09:26.973204 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:27.959391 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device f78412b9-105d-47e9-8444-ce7bf4a1a56f no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:09:27.982243 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: f78412b9-105d-47e9-8444-ce7bf4a1a56f {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:09:27.982877 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device f78412b9-105d-47e9-8444-ce7bf4a1a56f not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:09:31.045246 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d70b6d32-87b2-4c35-b9c8-b25309ce5995 req-64b2f081-1e37-42b1-a265-9aa993d8e34d tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:31.046720 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d70b6d32-87b2-4c35-b9c8-b25309ce5995 req-64b2f081-1e37-42b1-a265-9aa993d8e34d tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.1623602 Aug 24 03:09:31.084814 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d70b6d32-87b2-4c35-b9c8-b25309ce5995 req-ba2be7aa-0d6a-4e0c-bb5c-a0d1e29b09c4 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0317254 Aug 24 03:09:31.530111 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-285de17e-6bb2-4ae8-9344-68cfb8950868 req-73f8bee6-5311-4c15-93ad-b4aada5389e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:31.531542 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-285de17e-6bb2-4ae8-9344-68cfb8950868 req-73f8bee6-5311-4c15-93ad-b4aada5389e5 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=a74f1fd1896c4ed09ff280398fa2440f&device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 1137 time: 0.0408499 Aug 24 03:09:31.626059 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-285de17e-6bb2-4ae8-9344-68cfb8950868 req-3ba0d406-06c9-4afa-9e8e-be76b8a253f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:31.627507 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-285de17e-6bb2-4ae8-9344-68cfb8950868 req-3ba0d406-06c9-4afa-9e8e-be76b8a253f4 service neutron] 10.222.0.43 "GET /v2.0/networks?id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b HTTP/1.1" status: 200 len: 916 time: 0.0891120 Aug 24 03:09:31.696688 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-285de17e-6bb2-4ae8-9344-68cfb8950868 req-601827c2-b357-405d-bc4b-1e2eeed3fa84 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9 HTTP/1.1" status: 200 len: 1000 time: 0.0613527 Aug 24 03:09:31.746654 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-285de17e-6bb2-4ae8-9344-68cfb8950868 req-0f8ade21-a16a-4907-998a-11d2c8e03630 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:31.747998 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-285de17e-6bb2-4ae8-9344-68cfb8950868 req-0f8ade21-a16a-4907-998a-11d2c8e03630 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=f42fa902-0e1e-4185-b486-54648ea18f14 HTTP/1.1" status: 200 len: 854 time: 0.0413897 Aug 24 03:09:31.798687 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-285de17e-6bb2-4ae8-9344-68cfb8950868 req-a408524c-b835-4c0c-b21c-4920a24ee408 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:31.800064 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-285de17e-6bb2-4ae8-9344-68cfb8950868 req-a408524c-b835-4c0c-b21c-4920a24ee408 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0373034 Aug 24 03:09:31.890639 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-285de17e-6bb2-4ae8-9344-68cfb8950868 req-cc655316-b356-44ab-bd68-e0a53efbc69c service neutron] 10.222.0.43 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831103 Aug 24 03:09:31.977584 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-285de17e-6bb2-4ae8-9344-68cfb8950868 req-7b34d98e-36da-4dba-80c9-80b739595ed3 service neutron] 10.222.0.43 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0789547 Aug 24 03:09:32.258850 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f26be06-b76d-4e98-b8a3-23952c15b3bf req-38300de7-02ec-4a89-9895-fc2bd941d02a tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:32.260370 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3f26be06-b76d-4e98-b8a3-23952c15b3bf req-38300de7-02ec-4a89-9895-fc2bd941d02a tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.1085448 Aug 24 03:09:32.299143 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3f26be06-b76d-4e98-b8a3-23952c15b3bf req-4b129e15-44f9-4a12-9d92-5075803354f9 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0324621 Aug 24 03:09:33.434898 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83561362-5d43-4593-970b-6f8512187b36 req-837e623d-1ae2-4f0b-8ed1-c08366200711 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:33.436310 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-83561362-5d43-4593-970b-6f8512187b36 req-837e623d-1ae2-4f0b-8ed1-c08366200711 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.0590389 Aug 24 03:09:33.482122 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-83561362-5d43-4593-970b-6f8512187b36 req-aec07d1f-4f47-4b24-8bbc-94b554ae5557 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0391963 Aug 24 03:09:34.567217 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:09:34.604591 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f778c67-617a-4f3c-a09a-f48176a8924b req-b70a96ab-b96f-4e70-be19-dd21d4b5040e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:34.608270 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3f778c67-617a-4f3c-a09a-f48176a8924b req-b70a96ab-b96f-4e70-be19-dd21d4b5040e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.0557549 Aug 24 03:09:34.680688 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3f778c67-617a-4f3c-a09a-f48176a8924b req-b73dd06c-e898-46d2-bad2-29a5260ef87e tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0603602 Aug 24 03:09:35.798146 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c3b0fc-b38e-4583-8481-0c4d1614e2de req-d3ba4562-5bc8-42fa-97fd-e9935e006ab1 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:35.805945 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b8c3b0fc-b38e-4583-8481-0c4d1614e2de req-d3ba4562-5bc8-42fa-97fd-e9935e006ab1 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.0574374 Aug 24 03:09:35.845167 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b8c3b0fc-b38e-4583-8481-0c4d1614e2de req-e21d3495-6d3c-4de9-8c92-e108df902a88 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0382316 Aug 24 03:09:36.967702 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b64886f8-4ca3-490e-9d17-5dc6f27419da req-af796b66-6724-4d98-a7ea-b8969ea0a0c4 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:36.969193 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b64886f8-4ca3-490e-9d17-5dc6f27419da req-af796b66-6724-4d98-a7ea-b8969ea0a0c4 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.0528500 Aug 24 03:09:37.014234 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-b64886f8-4ca3-490e-9d17-5dc6f27419da req-1496b106-8aa1-4b69-8986-88df55486087 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0388627 Aug 24 03:09:38.144657 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36a32704-fd8b-47e7-91b5-7bbeec550356 req-d9bd6dd4-49c3-4f2c-ac62-e42984e49cd8 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:38.146425 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-36a32704-fd8b-47e7-91b5-7bbeec550356 req-d9bd6dd4-49c3-4f2c-ac62-e42984e49cd8 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.0603116 Aug 24 03:09:38.200447 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-36a32704-fd8b-47e7-91b5-7bbeec550356 req-b55f8831-aa5c-4c03-aa46-220c5e46bc99 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0464730 Aug 24 03:09:38.693190 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:39.345740 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f327a765-8f03-4ea1-9298-29c9815676b8 req-b82aeefd-e875-4550-a8b0-161be2311c8c tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:39.347311 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f327a765-8f03-4ea1-9298-29c9815676b8 req-b82aeefd-e875-4550-a8b0-161be2311c8c tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.0581946 Aug 24 03:09:39.400512 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f327a765-8f03-4ea1-9298-29c9815676b8 req-f41713a2-bf86-43f7-90a7-52bbc5dfde13 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0470130 Aug 24 03:09:40.538870 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43ad265-6748-423d-9aa0-b36c36da8c90 req-08f98168-32d4-41a2-9f5c-528c16a6cf84 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:40.541201 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d43ad265-6748-423d-9aa0-b36c36da8c90 req-08f98168-32d4-41a2-9f5c-528c16a6cf84 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.0667598 Aug 24 03:09:40.587697 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d43ad265-6748-423d-9aa0-b36c36da8c90 req-0ac515c3-80b5-4ee8-be64-0e6055272d92 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0395427 Aug 24 03:09:41.718171 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ca400b-b03f-4847-8aaf-e064c54e7d8f req-cd576707-85c8-4fb1-b5b5-15971a661628 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:41.720415 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e5ca400b-b03f-4847-8aaf-e064c54e7d8f req-cd576707-85c8-4fb1-b5b5-15971a661628 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.0542314 Aug 24 03:09:41.791605 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-e5ca400b-b03f-4847-8aaf-e064c54e7d8f req-f4150ee9-df04-42ba-b50b-aedbeaa407fd tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0635340 Aug 24 03:09:42.940744 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-77e17fad-cbea-405a-adae-10cb08efa485 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0785706 Aug 24 03:09:42.957172 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-795eef47-ee80-43f8-9ef1-e9962a21ee19 req-3468c442-e7f4-40d3-96ae-47296a64c190 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:42.965814 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-795eef47-ee80-43f8-9ef1-e9962a21ee19 req-3468c442-e7f4-40d3-96ae-47296a64c190 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.0648918 Aug 24 03:09:43.053175 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-827a1c13-fd59-4950-8e74-9fc55197782c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:43.055947 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-827a1c13-fd59-4950-8e74-9fc55197782c service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 1098 time: 0.0904565 Aug 24 03:09:43.083262 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-795eef47-ee80-43f8-9ef1-e9962a21ee19 req-faf81d44-5c5b-4dde-89df-a6085ff1e708 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1095705 Aug 24 03:09:43.194507 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-928ca518-fc99-43e5-962d-cf8a012dbecb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:43.195895 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-928ca518-fc99-43e5-962d-cf8a012dbecb service neutron] 10.222.0.43 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 913 time: 0.1075783 Aug 24 03:09:43.271826 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-a2e9f823-db69-4c6f-8a33-95196622518b service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=4137bd43-5447-4d24-a225-3161bde7b9ac HTTP/1.1" status: 200 len: 1001 time: 0.0660281 Aug 24 03:09:43.328241 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-78aa0866-15ce-42cc-bcb3-a11f22fb669c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:43.329970 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-78aa0866-15ce-42cc-bcb3-a11f22fb669c service neutron] 10.222.0.43 "GET /v2.0/subnets?id=9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 200 len: 851 time: 0.0509648 Aug 24 03:09:43.389079 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-f64fa949-2705-42da-9ec2-5dd7c5597cf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:43.391194 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-f64fa949-2705-42da-9ec2-5dd7c5597cf1 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0543358 Aug 24 03:09:43.403728 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-ad323c29-9387-4a44-b3d5-db3eac39edd9 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=111276) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Aug 24 03:09:43.404726 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-ad323c29-9387-4a44-b3d5-db3eac39edd9 service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0063360 Aug 24 03:09:43.534481 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-caabff7f-d0d0-4645-80f0-e9b7fa8afba2 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1212974 Aug 24 03:09:43.648942 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bc621f71-8daf-4917-a5e0-bf82b20edbcf req-c970133b-fed7-46d8-bf06-b5d3ae94cfbf service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1062765 Aug 24 03:09:44.198676 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88247cb-51ce-4d53-99cf-2b4d4066622c req-0bb115e8-e24e-449e-b36b-97be68e5b0ab tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:44.201549 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f88247cb-51ce-4d53-99cf-2b4d4066622c req-0bb115e8-e24e-449e-b36b-97be68e5b0ab tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.0525320 Aug 24 03:09:44.246649 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-f88247cb-51ce-4d53-99cf-2b4d4066622c req-5d2b5c57-0512-4208-9f70-113c3eed3948 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&id=ea9c22ab-a6b2-4c54-b7bf-3726f9559967&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0386944 Aug 24 03:09:51.392921 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-acb4644f-a70f-48d4-be6e-aca3c97b9fd0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:51.581111 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42132) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:51.628933 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Deleting subnet 627c2f10-e51d-47e0-a5a8-56279d49e835 {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:09:51.631932 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:51.664958 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:51.702877 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:51.840912 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:51.866162 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=627c2f10-e51d-47e0-a5a8-56279d49e835,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:51.870522 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:51.873471 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/627c2f10-e51d-47e0-a5a8-56279d49e835 HTTP/1.1" status: 204 len: 168 time: 0.2913067 Aug 24 03:09:51.876130 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42134) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:51.879578 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:51.879931 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:51.880267 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:51.880595 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:51.880924 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:51.881250 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:51.881603 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:51.881921 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:51.882242 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:51.882559 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:51.882878 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:51.883193 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3020c813-f49e-4b9b-bb7d-c7a699d7d333 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111275) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:51.949214 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:52.024236 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:52.034661 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['adbf6887-7b6e-435d-a4f0-ee186fa9ca6f']}} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:52.045006 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ee1686bb-3a57-460c-84bb-9999e3dc5965') {'for_net_delete': True} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:52.045294 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ee1686bb-3a57-460c-84bb-9999e3dc5965') {} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:52.054148 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25761368'] for segment, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:52.067295 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:52.073394 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Releasing vlan 380 on physical network physnet1 to pool {{(pid=111276) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:09:52.073834 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3525699'] for segment, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: Traceback (most recent call last): Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: timer() Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: cb(*args, **kw) Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: return func(*args, **kwargs) Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: self._notify() Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: self.callback(batched_events) Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: event.method(event) Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: return f(self, *a, **k) Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._get(url).json() Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: return self.request(url, 'GET', **kwargs) Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:09:52.075598 dv-cinder-803748-8-iscsi neutron-server[111276]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:09:52.181514 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:52.187409 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:52.191278 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] 10.222.0.30 "DELETE /v2.0/networks/adbf6887-7b6e-435d-a4f0-ee186fa9ca6f HTTP/1.1" status: 204 len: 168 time: 0.3121228 Aug 24 03:09:52.200581 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Pushing event deleted for resources: {'Network': ['ID=adbf6887-7b6e-435d-a4f0-ee186fa9ca6f,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:52.207683 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:52.208041 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:52.208383 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:52.208721 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:52.209048 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:52.209380 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:52.209736 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:52.210097 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:52.210426 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:52.210750 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:52.211070 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:52.211390 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29b8109f-9f92-4e19-8d1c-ff8df2f03f23 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111276) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:09:52.623813 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42138) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:52.663621 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-51b84533-0e73-4853-84cc-787aa0492034 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=340ed71ecf6140648b1ec802f4c9aacb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0386305 Aug 24 03:09:52.666091 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42140) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:52.712949 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4331c4dd-3c35-470b-9721-7ade611a4273 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:52.733532 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4331c4dd-3c35-470b-9721-7ade611a4273 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:52.875223 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4331c4dd-3c35-470b-9721-7ade611a4273 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:52.877749 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-4331c4dd-3c35-470b-9721-7ade611a4273 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:52.878902 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-4331c4dd-3c35-470b-9721-7ade611a4273 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/1a9da183-f230-46b4-b86f-b6b653e320d5 HTTP/1.1" status: 204 len: 168 time: 0.2119343 Aug 24 03:09:52.887237 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4331c4dd-3c35-470b-9721-7ade611a4273 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a9da183-f230-46b4-b86f-b6b653e320d5,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:53.983322 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-b77a7e20-befd-42ea-9873-be8f76378af1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:54.118579 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42168) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:09:54.290238 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Deleting port 2ec6506e-0834-429a-9737-e04b39a5cfba {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:09:54.293502 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:54.341859 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:54.364470 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:54.364799 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:54.376834 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Calling delete_port for 2ec6506e-0834-429a-9737-e04b39a5cfba owned by network:floatingip {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:09:54.607426 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:54.634741 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event deleted for resources: {'Port': ['ID=2ec6506e-0834-429a-9737-e04b39a5cfba,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:09:54.699046 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:54.699512 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.db.l3_db [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Floating IP dac795f4-6bda-4417-aa85-44e7c2f1e1b4 disassociated (deleted). External IP: 172.27.2.131, port: 4137bd43-5447-4d24-a225-3161bde7b9ac. Aug 24 03:09:54.914366 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:09:55.025996 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:09:55.031920 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:55.039677 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f67ccef-48ae-4a0a-9c50-23dcb241c1b5 None None] Sync routers for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:09:55.051479 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f67ccef-48ae-4a0a-9c50-23dcb241c1b5 None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:09:55.052251 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-4f67ccef-48ae-4a0a-9c50-23dcb241c1b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:09:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:55.063048 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-44a39694-2a07-40de-bf8e-82e9bbb91a4c tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "DELETE /v2.0/floatingips/dac795f4-6bda-4417-aa85-44e7c2f1e1b4 HTTP/1.1" status: 204 len: 168 time: 0.9431732 Aug 24 03:09:55.063630 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'tag': '4137bd43-5447-4d24-a225-3161bde7b9ac'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:09:55.066200 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d6d64c9-5449-40ae-ad26-fbc0e69b3d08" -d '{"events": [{"name": "network-changed", "server_uuid": "67b5653d-53be-4bd6-a58f-f8278215abe8", "tag": "4137bd43-5447-4d24-a225-3161bde7b9ac"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:09:55.126149 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:09:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ec632c0d-aa77-4d69-8e89-fbe34a1e2f30 x-openstack-request-id: req-ec632c0d-aa77-4d69-8e89-fbe34a1e2f30 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:09:55.126149 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "67b5653d-53be-4bd6-a58f-f8278215abe8", "tag": "4137bd43-5447-4d24-a225-3161bde7b9ac", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:09:55.126149 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-ec632c0d-aa77-4d69-8e89-fbe34a1e2f30 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:09:55.127160 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'tag': '4137bd43-5447-4d24-a225-3161bde7b9ac', 'status': 'completed', 'code': 200} Aug 24 03:09:55.185680 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-4f67ccef-48ae-4a0a-9c50-23dcb241c1b5 None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:09:55.289251 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6d64c9-5449-40ae-ad26-fbc0e69b3d08 req-acacc607-9beb-4ff6-a6bc-9c25ce00be62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:55.290831 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9d6d64c9-5449-40ae-ad26-fbc0e69b3d08 req-acacc607-9beb-4ff6-a6bc-9c25ce00be62 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 1098 time: 0.1426988 Aug 24 03:09:55.383144 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6d64c9-5449-40ae-ad26-fbc0e69b3d08 req-b2e100e8-4f2b-4b6e-ae34-a0c22c824344 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:55.384578 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9d6d64c9-5449-40ae-ad26-fbc0e69b3d08 req-b2e100e8-4f2b-4b6e-ae34-a0c22c824344 service neutron] 10.222.0.43 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 913 time: 0.0853462 Aug 24 03:09:55.417005 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-4f67ccef-48ae-4a0a-9c50-23dcb241c1b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'bb5fca44-f88d-40fe-b3a8-a36920d12ada', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.136', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 507, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:af:19:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b446c10-d1d6-4e68-959c-417655d2070b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:06:00Z', 'updated_at': '2021-08-24T03:06:03Z', 'revision_number': 1, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:55.431078 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9d6d64c9-5449-40ae-ad26-fbc0e69b3d08 req-e3cff29f-1ceb-4ec8-9050-3cb54dd4f752 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=4137bd43-5447-4d24-a225-3161bde7b9ac HTTP/1.1" status: 200 len: 217 time: 0.0386591 Aug 24 03:09:55.450583 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f67ccef-48ae-4a0a-9c50-23dcb241c1b5 None None] Checking router: 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:09:55.459205 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f67ccef-48ae-4a0a-9c50-23dcb241c1b5 None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:09:55.460136 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-4f67ccef-48ae-4a0a-9c50-23dcb241c1b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:09:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:55.493358 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6d64c9-5449-40ae-ad26-fbc0e69b3d08 req-859771b3-1994-40e9-9707-d8f62b7b0fc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:55.494918 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9d6d64c9-5449-40ae-ad26-fbc0e69b3d08 req-859771b3-1994-40e9-9707-d8f62b7b0fc7 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 200 len: 851 time: 0.0458906 Aug 24 03:09:55.515595 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaa58f94-a8bd-41dc-8539-29169c79636b req-5bf459ff-85f1-4a3d-a849-ca6d0e36aa41 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:55.517143 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-eaa58f94-a8bd-41dc-8539-29169c79636b req-5bf459ff-85f1-4a3d-a849-ca6d0e36aa41 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 945 time: 0.0593896 Aug 24 03:09:55.543254 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6d64c9-5449-40ae-ad26-fbc0e69b3d08 req-9efe119a-8c04-4a42-a536-0a86d0cb4883 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:55.544764 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9d6d64c9-5449-40ae-ad26-fbc0e69b3d08 req-9efe119a-8c04-4a42-a536-0a86d0cb4883 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0424955 Aug 24 03:09:55.559368 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-eaa58f94-a8bd-41dc-8539-29169c79636b req-e2495d69-cdf9-4639-8813-e0613864b32f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0358701 Aug 24 03:09:55.588975 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-4f67ccef-48ae-4a0a-9c50-23dcb241c1b5 None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:09:55.633856 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:55.647516 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9d6d64c9-5449-40ae-ad26-fbc0e69b3d08 req-4252e2d0-615b-4f2d-a71f-c4435e88159b service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0936236 Aug 24 03:09:55.738989 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-9d6d64c9-5449-40ae-ad26-fbc0e69b3d08 req-15cc7419-536f-422d-b4e7-e6664ae546ff service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823779 Aug 24 03:09:55.944019 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-4f67ccef-48ae-4a0a-9c50-23dcb241c1b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'bb5fca44-f88d-40fe-b3a8-a36920d12ada', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.136', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 507, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:af:19:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b446c10-d1d6-4e68-959c-417655d2070b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:06:00Z', 'updated_at': '2021-08-24T03:06:03Z', 'revision_number': 1, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:09:55.970315 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f67ccef-48ae-4a0a-9c50-23dcb241c1b5 None None] The sync data for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi is: [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_floatingips': [{'id': 'bb5fca44-f88d-40fe-b3a8-a36920d12ada', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'floating_ip_address': '172.27.2.136', 'floating_network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'router_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'port_id': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 507, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'mac_address': 'fa:16:3e:af:19:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b446c10-d1d6-4e68-959c-417655d2070b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-08-24T03:06:00Z', 'updated_at': '2021-08-24T03:06:03Z', 'revision_number': 1, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:09:56.181524 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c707461-ad18-4d32-b22f-13ace359467c None None] New status for floating IP dac795f4-6bda-4417-aa85-44e7c2f1e1b4: DOWN {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:09:56.679717 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7a3f46-a0e9-4552-9480-23b7880206b9 req-f0c682ab-50c2-40af-bf72-d7ae69a3d214 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:56.681210 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ee7a3f46-a0e9-4552-9480-23b7880206b9 req-f0c682ab-50c2-40af-bf72-d7ae69a3d214 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 945 time: 0.0513659 Aug 24 03:09:56.723258 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-ee7a3f46-a0e9-4552-9480-23b7880206b9 req-ea038d72-e995-45ab-ab38-e09963a09286 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0354054 Aug 24 03:09:56.994687 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:57.839414 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3773bfaa-db19-4f59-91e9-59ee1704f164 req-b51778c6-2f94-448c-9108-afe28c9ff31a tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:57.841481 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3773bfaa-db19-4f59-91e9-59ee1704f164 req-b51778c6-2f94-448c-9108-afe28c9ff31a tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 945 time: 0.0529754 Aug 24 03:09:57.876952 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-3773bfaa-db19-4f59-91e9-59ee1704f164 req-0d9cf091-a664-445e-ba4f-36605b6ca5bf tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0296319 Aug 24 03:09:58.993024 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b041649-c4de-4538-8a27-d0c0ba975afc req-3d7d4950-779d-443d-a0fa-9f9149d4ddef tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:58.994493 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3b041649-c4de-4538-8a27-d0c0ba975afc req-3d7d4950-779d-443d-a0fa-9f9149d4ddef tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 945 time: 0.0512235 Aug 24 03:09:59.033048 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-3b041649-c4de-4538-8a27-d0c0ba975afc req-625650e1-ec89-4b5c-bf86-c6a439e3c61a tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0323291 Aug 24 03:09:59.731252 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54aa8446-cc35-4c3a-8a37-c5f819557e1c req-2e7d039c-b1b5-452d-85c0-cb5b961b4a09 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:09:59.732721 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-54aa8446-cc35-4c3a-8a37-c5f819557e1c req-2e7d039c-b1b5-452d-85c0-cb5b961b4a09 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 945 time: 0.0484214 Aug 24 03:09:59.830051 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-54aa8446-cc35-4c3a-8a37-c5f819557e1c req-d7b4b6ec-a282-48d6-85b5-5060e794cccb tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Deleting port 4137bd43-5447-4d24-a225-3161bde7b9ac {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:09:59.830414 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-54aa8446-cc35-4c3a-8a37-c5f819557e1c req-d7b4b6ec-a282-48d6-85b5-5060e794cccb tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:59.914631 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-54aa8446-cc35-4c3a-8a37-c5f819557e1c req-d7b4b6ec-a282-48d6-85b5-5060e794cccb tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] For port 4137bd43-5447-4d24-a225-3161bde7b9ac, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=4137bd43-5447-4d24-a225-3161bde7b9ac,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:09:59.914997 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-54aa8446-cc35-4c3a-8a37-c5f819557e1c req-d7b4b6ec-a282-48d6-85b5-5060e794cccb tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:09:59.927188 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-54aa8446-cc35-4c3a-8a37-c5f819557e1c req-d7b4b6ec-a282-48d6-85b5-5060e794cccb tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Calling delete_port for 4137bd43-5447-4d24-a225-3161bde7b9ac owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:00.109119 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-54aa8446-cc35-4c3a-8a37-c5f819557e1c req-d7b4b6ec-a282-48d6-85b5-5060e794cccb tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:00.126477 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-abb33f79-07df-48eb-8a0f-f3423f3b02df req-b303b386-5640-40b7-b126-e9fa084791f2 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 210 time: 0.0276551 Aug 24 03:10:00.161246 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7b4b6ec-a282-48d6-85b5-5060e794cccb tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event deleted for resources: {'Port': ['ID=4137bd43-5447-4d24-a225-3161bde7b9ac,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:00.183678 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-54aa8446-cc35-4c3a-8a37-c5f819557e1c req-d7b4b6ec-a282-48d6-85b5-5060e794cccb tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] No DVR routers for this DVR port 4137bd43-5447-4d24-a225-3161bde7b9ac on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:10:00.186346 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-54aa8446-cc35-4c3a-8a37-c5f819557e1c req-d7b4b6ec-a282-48d6-85b5-5060e794cccb tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:00.188675 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-54aa8446-cc35-4c3a-8a37-c5f819557e1c req-d7b4b6ec-a282-48d6-85b5-5060e794cccb tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "DELETE /v2.0/ports/4137bd43-5447-4d24-a225-3161bde7b9ac HTTP/1.1" status: 204 len: 173 time: 0.4501350 Aug 24 03:10:00.189111 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'name': 'network-vif-deleted', 'tag': '4137bd43-5447-4d24-a225-3161bde7b9ac'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:10:00.191437 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01205aa5-e984-40f8-8dc7-a812dbc121a0" -d '{"events": [{"server_uuid": "67b5653d-53be-4bd6-a58f-f8278215abe8", "name": "network-vif-deleted", "tag": "4137bd43-5447-4d24-a225-3161bde7b9ac"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:10:00.227443 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:10:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0ede9f1-2516-4c2e-a69a-9d6fdcbd02f9 x-openstack-request-id: req-e0ede9f1-2516-4c2e-a69a-9d6fdcbd02f9 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:10:00.227736 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "67b5653d-53be-4bd6-a58f-f8278215abe8", "name": "network-vif-deleted", "tag": "4137bd43-5447-4d24-a225-3161bde7b9ac", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:10:00.227983 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-e0ede9f1-2516-4c2e-a69a-9d6fdcbd02f9 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:10:00.228370 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '67b5653d-53be-4bd6-a58f-f8278215abe8', 'name': 'network-vif-deleted', 'tag': '4137bd43-5447-4d24-a225-3161bde7b9ac', 'status': 'completed', 'code': 200} Aug 24 03:10:01.231614 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-c8267d6c-93bf-4b9f-a8e5-2b77956125ed req-e3920c96-c99c-4389-aa3c-d1807c1e363f tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=67b5653d-53be-4bd6-a58f-f8278215abe8 HTTP/1.1" status: 200 len: 210 time: 0.0254149 Aug 24 03:10:02.161256 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 4137bd43-5447-4d24-a225-3161bde7b9ac no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:02.180495 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: 4137bd43-5447-4d24-a225-3161bde7b9ac {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:02.180836 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device 4137bd43-5447-4d24-a225-3161bde7b9ac not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:03.459925 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42240) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:03.562311 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3fc73c03-53ae-4e1b-8f58-51258415522a admin admin] Notify callbacks [] for security_group, before_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:03.655233 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3fc73c03-53ae-4e1b-8f58-51258415522a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:03.726386 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-3fc73c03-53ae-4e1b-8f58-51258415522a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_create {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:03.764824 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-3fc73c03-53ae-4e1b-8f58-51258415522a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=4ef6581c8471403c8ffa44a0697f3742&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3038712 Aug 24 03:10:03.766085 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc73c03-53ae-4e1b-8f58-51258415522a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac7196b4-dee2-4d36-a4b3-bdca2ad4eb46,revision_number=1']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:03.767568 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42250) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:03.821932 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ca60e21f-f9df-4ea1-b3e1-b2003f94912c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:03.842756 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ca60e21f-f9df-4ea1-b3e1-b2003f94912c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:03.977406 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ca60e21f-f9df-4ea1-b3e1-b2003f94912c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:03.980592 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ca60e21f-f9df-4ea1-b3e1-b2003f94912c admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:03.981763 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-ca60e21f-f9df-4ea1-b3e1-b2003f94912c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ac7196b4-dee2-4d36-a4b3-bdca2ad4eb46 HTTP/1.1" status: 204 len: 168 time: 0.2122982 Aug 24 03:10:03.989919 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca60e21f-f9df-4ea1-b3e1-b2003f94912c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac7196b4-dee2-4d36-a4b3-bdca2ad4eb46,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:04.753700 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42256) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:04.905320 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Deleting port c3ff8651-849b-44d4-9b54-c66e81407c59 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:04.907672 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:04.980691 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:04.981105 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:04.992169 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Calling delete_port for c3ff8651-849b-44d4-9b54-c66e81407c59 owned by network:floatingip {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:05.211410 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:05.240228 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event deleted for resources: {'Port': ['ID=c3ff8651-849b-44d4-9b54-c66e81407c59,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:05.300411 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:05.300741 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.l3_db [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Floating IP bb5fca44-f88d-40fe-b3a8-a36920d12ada disassociated (deleted). External IP: 172.27.2.136, port: a8f7945f-96cc-40aa-897c-b9f7dd88be75. Aug 24 03:10:05.502071 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:10:05.605878 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:10:05.610624 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:05.620156 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97c107dd-5846-4c69-a074-51e57f5185cb None None] Sync routers for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:10:05.630488 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97c107dd-5846-4c69-a074-51e57f5185cb None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:10:05.631100 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-97c107dd-5846-4c69-a074-51e57f5185cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:09:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:05.637310 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-9f88cd33-b782-4ad7-88a0-ac6fd66ea738 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "DELETE /v2.0/floatingips/bb5fca44-f88d-40fe-b3a8-a36920d12ada HTTP/1.1" status: 204 len: 168 time: 0.8824930 Aug 24 03:10:05.637985 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5b446c10-d1d6-4e68-959c-417655d2070b', 'tag': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:10:05.640232 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb50a04f-dbf9-48de-9d25-917a7ca6852e" -d '{"events": [{"name": "network-changed", "server_uuid": "5b446c10-d1d6-4e68-959c-417655d2070b", "tag": "a8f7945f-96cc-40aa-897c-b9f7dd88be75"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:10:05.743804 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-97c107dd-5846-4c69-a074-51e57f5185cb None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:10:05.854086 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:10:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f73db245-1df9-4788-97e5-56ac73d81d48 x-openstack-request-id: req-f73db245-1df9-4788-97e5-56ac73d81d48 {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:10:05.854412 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5b446c10-d1d6-4e68-959c-417655d2070b", "tag": "a8f7945f-96cc-40aa-897c-b9f7dd88be75", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:10:05.855271 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-f73db245-1df9-4788-97e5-56ac73d81d48 {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:10:05.855767 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5b446c10-d1d6-4e68-959c-417655d2070b', 'tag': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'status': 'completed', 'code': 200} Aug 24 03:10:05.926769 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb50a04f-dbf9-48de-9d25-917a7ca6852e req-b8e11ae8-b7b2-41a9-b73f-385f401f4dd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:05.928269 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb50a04f-dbf9-48de-9d25-917a7ca6852e req-b8e11ae8-b7b2-41a9-b73f-385f401f4dd7 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=03198f839b864099b1c011c0fc54c7dd&device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 1098 time: 0.0490339 Aug 24 03:10:05.953382 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-97c107dd-5846-4c69-a074-51e57f5185cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:05.982964 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97c107dd-5846-4c69-a074-51e57f5185cb None None] Checking router: 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:10:05.991378 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97c107dd-5846-4c69-a074-51e57f5185cb None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:10:05.992000 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-97c107dd-5846-4c69-a074-51e57f5185cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:09:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:06.025825 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb50a04f-dbf9-48de-9d25-917a7ca6852e req-2a4db7d8-6d85-4824-873a-38ef0dde7743 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:06.028078 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb50a04f-dbf9-48de-9d25-917a7ca6852e req-2a4db7d8-6d85-4824-873a-38ef0dde7743 service neutron] 10.222.0.43 "GET /v2.0/networks?id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 200 len: 913 time: 0.0925367 Aug 24 03:10:06.080062 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb50a04f-dbf9-48de-9d25-917a7ca6852e req-065027af-0196-419f-8549-a3d3d01b3d16 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a8f7945f-96cc-40aa-897c-b9f7dd88be75 HTTP/1.1" status: 200 len: 217 time: 0.0433419 Aug 24 03:10:06.099974 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-97c107dd-5846-4c69-a074-51e57f5185cb None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:10:06.154636 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b982b5cb-f05c-40fb-b1e4-2a2eb87d5731 req-941ca7de-ab3c-42ec-8d42-a51d7cb0a64e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:06.156099 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b982b5cb-f05c-40fb-b1e4-2a2eb87d5731 req-941ca7de-ab3c-42ec-8d42-a51d7cb0a64e tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 945 time: 0.1123152 Aug 24 03:10:06.157387 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb50a04f-dbf9-48de-9d25-917a7ca6852e req-0b59aa3c-4ba6-48e3-83ae-c0b370eeae31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:06.158721 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb50a04f-dbf9-48de-9d25-917a7ca6852e req-0b59aa3c-4ba6-48e3-83ae-c0b370eeae31 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 200 len: 851 time: 0.0641420 Aug 24 03:10:06.220680 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-b982b5cb-f05c-40fb-b1e4-2a2eb87d5731 req-cd0ec47f-a98a-4c05-9f3b-b076d4d113e5 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0580704 Aug 24 03:10:06.228870 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb50a04f-dbf9-48de-9d25-917a7ca6852e req-2fc94371-58c2-4c4f-99b6-f4c1ce3f6fe1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:06.230494 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb50a04f-dbf9-48de-9d25-917a7ca6852e req-2fc94371-58c2-4c4f-99b6-f4c1ce3f6fe1 service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0611281 Aug 24 03:10:06.296840 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-97c107dd-5846-4c69-a074-51e57f5185cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:06.322870 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb50a04f-dbf9-48de-9d25-917a7ca6852e req-1b59ab00-8850-4b73-a139-bd3e4ad4b009 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842609 Aug 24 03:10:06.323139 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97c107dd-5846-4c69-a074-51e57f5185cb None None] The sync data for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi is: [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:02:07Z', 'revision_number': 4, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': '4b3cf046-5f07-4c52-b229-289330f08157', 'name': '', 'network_id': '3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'mac_address': 'fa:16:3e:b0:dc:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_interface', 'standard_attr_id': 380, 'fixed_ips': [{'subnet_id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:07Z', 'updated_at': '2021-08-24T03:02:14Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'subnets': [{'id': '9d24a59e-1441-41fd-b523-3368836ed9c4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:10:06.544535 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-322a391f-fed0-4988-b6d2-e4aaaae8dbea None None] New status for floating IP bb5fca44-f88d-40fe-b3a8-a36920d12ada: DOWN {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:10:06.672880 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-bb50a04f-dbf9-48de-9d25-917a7ca6852e req-c0775c4e-75b0-48ea-a054-5c2f433a9507 service neutron] 10.222.0.43 "GET /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3413231 Aug 24 03:10:07.338794 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3d1e44-d47e-4a1a-a0b1-fceccf3a09d7 req-48efa4a9-df38-458f-bd2b-d5b75438c800 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:07.340451 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ad3d1e44-d47e-4a1a-a0b1-fceccf3a09d7 req-48efa4a9-df38-458f-bd2b-d5b75438c800 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 945 time: 0.0491142 Aug 24 03:10:07.377323 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-ad3d1e44-d47e-4a1a-a0b1-fceccf3a09d7 req-35953e52-8940-42c0-adef-420ebea4a8d1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/security-groups?id=b69cad14-2388-40cc-8cc6-0b7d617b183d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310614 Aug 24 03:10:07.610913 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-671f4c23-6044-4473-a7c3-975fba8cc1a2 req-25bfcbf5-4c77-40b3-bb4a-d351a509ee0d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:07.612337 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-671f4c23-6044-4473-a7c3-975fba8cc1a2 req-25bfcbf5-4c77-40b3-bb4a-d351a509ee0d tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 945 time: 0.0464776 Aug 24 03:10:07.711745 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-671f4c23-6044-4473-a7c3-975fba8cc1a2 req-32e04eb9-4439-4248-a8e9-b9812d4c6de0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Deleting port a8f7945f-96cc-40aa-897c-b9f7dd88be75 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:07.712082 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-671f4c23-6044-4473-a7c3-975fba8cc1a2 req-32e04eb9-4439-4248-a8e9-b9812d4c6de0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:07.796696 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-671f4c23-6044-4473-a7c3-975fba8cc1a2 req-32e04eb9-4439-4248-a8e9-b9812d4c6de0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] For port a8f7945f-96cc-40aa-897c-b9f7dd88be75, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=a8f7945f-96cc-40aa-897c-b9f7dd88be75,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:07.797058 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-671f4c23-6044-4473-a7c3-975fba8cc1a2 req-32e04eb9-4439-4248-a8e9-b9812d4c6de0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:07.808719 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-671f4c23-6044-4473-a7c3-975fba8cc1a2 req-32e04eb9-4439-4248-a8e9-b9812d4c6de0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Calling delete_port for a8f7945f-96cc-40aa-897c-b9f7dd88be75 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:08.011816 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-671f4c23-6044-4473-a7c3-975fba8cc1a2 req-32e04eb9-4439-4248-a8e9-b9812d4c6de0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:08.039867 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e04eb9-4439-4248-a8e9-b9812d4c6de0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event deleted for resources: {'Port': ['ID=a8f7945f-96cc-40aa-897c-b9f7dd88be75,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:08.083967 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-671f4c23-6044-4473-a7c3-975fba8cc1a2 req-32e04eb9-4439-4248-a8e9-b9812d4c6de0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] No DVR routers for this DVR port a8f7945f-96cc-40aa-897c-b9f7dd88be75 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:10:08.086395 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-671f4c23-6044-4473-a7c3-975fba8cc1a2 req-32e04eb9-4439-4248-a8e9-b9812d4c6de0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:08.088311 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-671f4c23-6044-4473-a7c3-975fba8cc1a2 req-32e04eb9-4439-4248-a8e9-b9812d4c6de0 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.43 "DELETE /v2.0/ports/a8f7945f-96cc-40aa-897c-b9f7dd88be75 HTTP/1.1" status: 204 len: 173 time: 0.4700866 Aug 24 03:10:08.088808 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5b446c10-d1d6-4e68-959c-417655d2070b', 'name': 'network-vif-deleted', 'tag': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:10:08.092001 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-903df666-7e0c-4b87-9643-ec2f58b7e11b" -d '{"events": [{"server_uuid": "5b446c10-d1d6-4e68-959c-417655d2070b", "name": "network-vif-deleted", "tag": "a8f7945f-96cc-40aa-897c-b9f7dd88be75"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:10:08.187828 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:10:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cffcc204-aeb8-4105-9724-610f3cb017e5 x-openstack-request-id: req-cffcc204-aeb8-4105-9724-610f3cb017e5 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:10:08.188121 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5b446c10-d1d6-4e68-959c-417655d2070b", "name": "network-vif-deleted", "tag": "a8f7945f-96cc-40aa-897c-b9f7dd88be75", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:10:08.188371 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-cffcc204-aeb8-4105-9724-610f3cb017e5 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:10:08.188760 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5b446c10-d1d6-4e68-959c-417655d2070b', 'name': 'network-vif-deleted', 'tag': 'a8f7945f-96cc-40aa-897c-b9f7dd88be75', 'status': 'completed', 'code': 200} Aug 24 03:10:08.472151 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-7401041f-fcbc-4626-b079-52521cd2e98c req-2dbb36ab-6aca-4784-bdaa-aec74d7aab75 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "GET /v2.0/ports?device_id=5b446c10-d1d6-4e68-959c-417655d2070b HTTP/1.1" status: 200 len: 210 time: 0.0267217 Aug 24 03:10:08.627058 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:09.527975 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42276) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:09.654827 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-850c3c72-dbbf-4814-805c-27d377ea3ca1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Deleting port b8e7b6dd-ec71-400b-9130-93076be161d3 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:09.655168 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-850c3c72-dbbf-4814-805c-27d377ea3ca1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:09.731429 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-850c3c72-dbbf-4814-805c-27d377ea3ca1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:09.731750 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-850c3c72-dbbf-4814-805c-27d377ea3ca1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:09.742904 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-850c3c72-dbbf-4814-805c-27d377ea3ca1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Calling delete_port for b8e7b6dd-ec71-400b-9130-93076be161d3 owned by network:floatingip {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:09.943103 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-850c3c72-dbbf-4814-805c-27d377ea3ca1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:09.969223 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-850c3c72-dbbf-4814-805c-27d377ea3ca1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event deleted for resources: {'Port': ['ID=b8e7b6dd-ec71-400b-9130-93076be161d3,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:10.039371 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-850c3c72-dbbf-4814-805c-27d377ea3ca1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for floatingip, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:10.041937 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-850c3c72-dbbf-4814-805c-27d377ea3ca1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:10.043489 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-850c3c72-dbbf-4814-805c-27d377ea3ca1 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "DELETE /v2.0/floatingips/8bd3ec8e-9712-4a9c-96d2-64724391335a HTTP/1.1" status: 204 len: 168 time: 0.5144241 Aug 24 03:10:10.200675 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device a8f7945f-96cc-40aa-897c-b9f7dd88be75 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:10.221170 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: a8f7945f-96cc-40aa-897c-b9f7dd88be75 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:10.221512 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device a8f7945f-96cc-40aa-897c-b9f7dd88be75 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:11.384548 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42288) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:11.444105 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9a674afd-6a88-446b-b287-2ed6d597e224 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:11.468395 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9a674afd-6a88-446b-b287-2ed6d597e224 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:11.565858 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:10:11.592436 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9a674afd-6a88-446b-b287-2ed6d597e224 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:11.595039 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-9a674afd-6a88-446b-b287-2ed6d597e224 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:11.596189 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-9a674afd-6a88-446b-b287-2ed6d597e224 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] 10.222.0.30 "DELETE /v2.0/security-groups/b69cad14-2388-40cc-8cc6-0b7d617b183d HTTP/1.1" status: 204 len: 168 time: 0.2106416 Aug 24 03:10:11.605795 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a674afd-6a88-446b-b287-2ed6d597e224 tempest-TestVolumeBootPattern-982457995 tempest-TestVolumeBootPattern-982457995-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b69cad14-2388-40cc-8cc6-0b7d617b183d,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:11.720519 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42292) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:12.197026 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a120fffe-9fc0-4ee9-a02c-3b964455517d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-566649'] for router_interface, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:12.422992 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-a120fffe-9fc0-4ee9-a02c-3b964455517d admin admin] Deleting port 4b3cf046-5f07-4c52-b229-289330f08157 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:12.423697 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a120fffe-9fc0-4ee9-a02c-3b964455517d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:12.500349 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-a120fffe-9fc0-4ee9-a02c-3b964455517d admin admin] For port 4b3cf046-5f07-4c52-b229-289330f08157, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=4b3cf046-5f07-4c52-b229-289330f08157,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:12.500710 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a120fffe-9fc0-4ee9-a02c-3b964455517d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:12.512478 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-a120fffe-9fc0-4ee9-a02c-3b964455517d admin admin] Calling delete_port for 4b3cf046-5f07-4c52-b229-289330f08157 owned by network:router_interface {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:12.748382 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a120fffe-9fc0-4ee9-a02c-3b964455517d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:12.771505 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a120fffe-9fc0-4ee9-a02c-3b964455517d admin admin] Pushing event deleted for resources: {'Port': ['ID=4b3cf046-5f07-4c52-b229-289330f08157,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:12.936149 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a120fffe-9fc0-4ee9-a02c-3b964455517d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-748285', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-566109'] for router_interface, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:13.141071 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a120fffe-9fc0-4ee9-a02c-3b964455517d admin admin] Router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:10:13.248717 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a120fffe-9fc0-4ee9-a02c-3b964455517d admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:10:13.256151 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a120fffe-9fc0-4ee9-a02c-3b964455517d admin admin] 10.222.0.30 "PUT /v2.0/routers/5a2fd9fa-c21b-4040-88a2-5ddfbec68dca/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5320685 Aug 24 03:10:13.256267 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42296) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:13.257001 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6a7a54d-8a03-45f1-89d1-2af1582bf79d None None] Sync routers for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:10:13.270305 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6a7a54d-8a03-45f1-89d1-2af1582bf79d None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:10:13.270915 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-d6a7a54d-8a03-45f1-89d1-2af1582bf79d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:09:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:13.377208 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-d6a7a54d-8a03-45f1-89d1-2af1582bf79d None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:10:13.560066 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-d6a7a54d-8a03-45f1-89d1-2af1582bf79d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:10:12Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:13.585868 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6a7a54d-8a03-45f1-89d1-2af1582bf79d None None] Checking router: 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:10:13.594639 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6a7a54d-8a03-45f1-89d1-2af1582bf79d None None] Routers {'5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:10:13.595251 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-d6a7a54d-8a03-45f1-89d1-2af1582bf79d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:09:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:13.598665 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Notify callbacks [] for router, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:13.699425 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:13.699915 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-d6a7a54d-8a03-45f1-89d1-2af1582bf79d None None] Set router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:10:13.842841 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Deleting port ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:13.843094 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:13.877271 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-d6a7a54d-8a03-45f1-89d1-2af1582bf79d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:10:12Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:13.924552 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] For port ccb38e4a-a5cf-4b55-9e55-d894d0b923d5, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=ccb38e4a-a5cf-4b55-9e55-d894d0b923d5,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:13.924927 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:13.938744 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Calling delete_port for ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 owned by network:router_gateway {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:14.024109 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6a7a54d-8a03-45f1-89d1-2af1582bf79d None None] The sync data for ids ['5a2fd9fa-c21b-4040-88a2-5ddfbec68dca'] in dv-cinder-803748-8-iscsi is: [{'id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'name': 'tempest-TestVolumeBootPattern-1460800652-router', 'tenant_id': '03198f839b864099b1c011c0fc54c7dd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120'}], 'enable_snat': True}, 'gw_port_id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:03Z', 'updated_at': '2021-08-24T03:10:12Z', 'revision_number': 5, 'project_id': '03198f839b864099b1c011c0fc54c7dd', 'gw_port': {'id': 'ccb38e4a-a5cf-4b55-9e55-d894d0b923d5', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:30:f8:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5a2fd9fa-c21b-4040-88a2-5ddfbec68dca', 'device_owner': 'network:router_gateway', 'standard_attr_id': 379, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:04Z', 'updated_at': '2021-08-24T03:02:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:10:14.169972 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:14.195274 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Pushing event deleted for resources: {'Port': ['ID=ccb38e4a-a5cf-4b55-9e55-d894d0b923d5,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:14.254229 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-569567'] for router_gateway, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:14.340476 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-560207', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32699'] for router, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:14.342432 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:14.495893 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557756'] for router, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:14.496471 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5a2fd9fa-c21b-4040-88a2-5ddfbec68dca {{(pid=111275) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Aug 24 03:10:14.500880 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] Notify callbacks [] for router, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:14.502151 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-6e4b9b57-b69e-47d1-9075-47f60cd01fbe admin admin] 10.222.0.30 "DELETE /v2.0/routers/5a2fd9fa-c21b-4040-88a2-5ddfbec68dca HTTP/1.1" status: 204 len: 168 time: 1.2450504 Aug 24 03:10:14.504747 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42298) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:14.549814 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-7edebec0-b2a4-429e-8d8d-cbc3b2f046ef admin admin] Deleting subnet 9d24a59e-1441-41fd-b523-3368836ed9c4 {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:10:14.552740 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7edebec0-b2a4-429e-8d8d-cbc3b2f046ef admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:14.586670 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7edebec0-b2a4-429e-8d8d-cbc3b2f046ef admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:14.674743 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7edebec0-b2a4-429e-8d8d-cbc3b2f046ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:14.800568 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7edebec0-b2a4-429e-8d8d-cbc3b2f046ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:14.824121 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7edebec0-b2a4-429e-8d8d-cbc3b2f046ef admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9d24a59e-1441-41fd-b523-3368836ed9c4,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:14.830208 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-7edebec0-b2a4-429e-8d8d-cbc3b2f046ef admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:14.832564 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-7edebec0-b2a4-429e-8d8d-cbc3b2f046ef admin admin] 10.222.0.30 "DELETE /v2.0/subnets/9d24a59e-1441-41fd-b523-3368836ed9c4 HTTP/1.1" status: 204 len: 168 time: 0.3264303 Aug 24 03:10:14.835664 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42300) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:14.838214 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dca4e2da-425a-4674-a5dc-8c30aec21c1f None None] Network 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:10:14.900726 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:14.957852 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Deleting port aa1019b3-2b1f-46ea-b266-575c301f0fc2 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:14.958238 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:15.019633 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] For port aa1019b3-2b1f-46ea-b266-575c301f0fc2, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=aa1019b3-2b1f-46ea-b266-575c301f0fc2,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:15.019999 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:15.033382 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Calling delete_port for aa1019b3-2b1f-46ea-b266-575c301f0fc2 owned by network:dhcp {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:15.039633 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b146cbdc-bb7c-42cd-97cc-94132f7d6713 None None] DHCP port deletion for 3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 request from dv-cinder-803748-8-iscsi {{(pid=111277) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Aug 24 03:10:15.086231 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-b146cbdc-bb7c-42cd-97cc-94132f7d6713 None None] Deleting port aa1019b3-2b1f-46ea-b266-575c301f0fc2 {{(pid=111277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:15.086611 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-b146cbdc-bb7c-42cd-97cc-94132f7d6713 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:15.149314 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-b146cbdc-bb7c-42cd-97cc-94132f7d6713 None None] For port aa1019b3-2b1f-46ea-b266-575c301f0fc2, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=aa1019b3-2b1f-46ea-b266-575c301f0fc2,segment=NetworkSegment(fb76a34d-79be-499b-a9c7-0f51849f60f3),segment_id=fb76a34d-79be-499b-a9c7-0f51849f60f3)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:15.149747 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-b146cbdc-bb7c-42cd-97cc-94132f7d6713 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:15.162767 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-b146cbdc-bb7c-42cd-97cc-94132f7d6713 None None] Calling delete_port for aa1019b3-2b1f-46ea-b266-575c301f0fc2 owned by network:dhcp {{(pid=111277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:15.176493 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:15.203720 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Pushing event deleted for resources: {'Port': ['ID=aa1019b3-2b1f-46ea-b266-575c301f0fc2,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:15.207476 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] No DVR routers for this DVR port aa1019b3-2b1f-46ea-b266-575c301f0fc2 on host dv-cinder-803748-8-iscsi {{(pid=111275) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:10:15.247731 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:15.270188 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:15.271060 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device ccb38e4a-a5cf-4b55-9e55-d894d0b923d5 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:15.271060 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 4b3cf046-5f07-4c52-b229-289330f08157 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:15.272559 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-b146cbdc-bb7c-42cd-97cc-94132f7d6713 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054'] for port, after_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:15.283425 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:15.293191 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6']}} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:15.303565 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fb76a34d-79be-499b-a9c7-0f51849f60f3') {'for_net_delete': True} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:15.303862 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fb76a34d-79be-499b-a9c7-0f51849f60f3') {} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:15.313177 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25719248'] for segment, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:15.316978 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: 4b3cf046-5f07-4c52-b229-289330f08157 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:15.317323 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 4b3cf046-5f07-4c52-b229-289330f08157 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:15.317762 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device aa1019b3-2b1f-46ea-b266-575c301f0fc2 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:15.320502 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b146cbdc-bb7c-42cd-97cc-94132f7d6713 None None] Pushing event deleted for resources: {'Port': ['ID=aa1019b3-2b1f-46ea-b266-575c301f0fc2,revision_number=None']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:15.331064 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:15.336850 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Releasing vlan 385 on physical network physnet1 to pool {{(pid=111275) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:10:15.337234 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3484247'] for segment, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: Traceback (most recent call last): Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: timer() Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: cb(*args, **kw) Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: return func(*args, **kwargs) Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: self._notify() Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: self.callback(batched_events) Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: event.method(event) Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: return f(self, *a, **k) Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._get(url).json() Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: return self.request(url, 'GET', **kwargs) Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:10:15.338873 dv-cinder-803748-8-iscsi neutron-server[111275]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:10:15.342372 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: aa1019b3-2b1f-46ea-b266-575c301f0fc2 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:15.342372 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device aa1019b3-2b1f-46ea-b266-575c301f0fc2 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:15.342372 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b146cbdc-bb7c-42cd-97cc-94132f7d6713 None None] No DVR routers for this DVR port aa1019b3-2b1f-46ea-b266-575c301f0fc2 on host dv-cinder-803748-8-iscsi {{(pid=111277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:10:15.496716 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:15.502016 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:15.503831 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] 10.222.0.30 "DELETE /v2.0/networks/3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6 HTTP/1.1" status: 204 len: 168 time: 0.6680012 Aug 24 03:10:15.507024 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42302) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:15.514697 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff18895c-df69-4d53-9674-333c0076a21f admin admin] Pushing event deleted for resources: {'Network': ['ID=3cabd5f8-1f7c-415c-9bad-79edc8a6f1d6,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:15.846328 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-56d5de23-4f71-4d2f-a82c-84b83ada1a86 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-566649'] for router_interface, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:16.092207 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-56d5de23-4f71-4d2f-a82c-84b83ada1a86 admin admin] Deleting port 9965b4e1-c80d-431e-9f19-6ebd3262cd07 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:16.092546 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-56d5de23-4f71-4d2f-a82c-84b83ada1a86 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:16.171565 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [None req-56d5de23-4f71-4d2f-a82c-84b83ada1a86 admin admin] For port 9965b4e1-c80d-431e-9f19-6ebd3262cd07, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=9965b4e1-c80d-431e-9f19-6ebd3262cd07,segment=NetworkSegment(7f24683c-fde3-41b9-a14e-aac1a7e5eb69),segment_id=7f24683c-fde3-41b9-a14e-aac1a7e5eb69)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:16.171854 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-56d5de23-4f71-4d2f-a82c-84b83ada1a86 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:16.184026 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-56d5de23-4f71-4d2f-a82c-84b83ada1a86 admin admin] Calling delete_port for 9965b4e1-c80d-431e-9f19-6ebd3262cd07 owned by network:router_interface {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:16.415559 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-56d5de23-4f71-4d2f-a82c-84b83ada1a86 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:16.442997 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d5de23-4f71-4d2f-a82c-84b83ada1a86 admin admin] Pushing event deleted for resources: {'Port': ['ID=9965b4e1-c80d-431e-9f19-6ebd3262cd07,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:16.605604 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-56d5de23-4f71-4d2f-a82c-84b83ada1a86 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-748285', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-566109'] for router_interface, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:16.740788 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-08beaa75-b6b9-4a6d-a0c5-57e646d9707f req-638b6094-8281-4b42-baf7-8671faf2f617 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1620221756&fields=id&tenant_id=a74f1fd1896c4ed09ff280398fa2440f HTTP/1.1" status: 200 len: 267 time: 0.0455179 Aug 24 03:10:16.861952 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08beaa75-b6b9-4a6d-a0c5-57e646d9707f req-17fcbf42-7de0-486f-810b-573940adf6a6 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:16.863384 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-08beaa75-b6b9-4a6d-a0c5-57e646d9707f req-17fcbf42-7de0-486f-810b-573940adf6a6 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 984 time: 0.0864162 Aug 24 03:10:16.876873 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.v2.base [req-08beaa75-b6b9-4a6d-a0c5-57e646d9707f req-1f7c9427-bd22-4efc-ad61-7fe1677e2f76 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Request body: {'port': {'security_groups': ['9abe615f-f88c-4d6c-97fa-2384752d2c4b']}} {{(pid=111276) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Aug 24 03:10:16.906428 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-56d5de23-4f71-4d2f-a82c-84b83ada1a86 admin admin] Router 71ad6783-2e04-4eb2-b203-4974f765b8e8 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:10:16.989007 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-08beaa75-b6b9-4a6d-a0c5-57e646d9707f req-1f7c9427-bd22-4efc-ad61-7fe1677e2f76 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-16374479'] for port, before_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.088225 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-56d5de23-4f71-4d2f-a82c-84b83ada1a86 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:10:17.097294 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e48c6244-6e97-495e-8453-994665914a6f None None] Sync routers for ids ['71ad6783-2e04-4eb2-b203-4974f765b8e8'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:10:17.097845 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-56d5de23-4f71-4d2f-a82c-84b83ada1a86 admin admin] 10.222.0.30 "PUT /v2.0/routers/71ad6783-2e04-4eb2-b203-4974f765b8e8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5896499 Aug 24 03:10:17.100305 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42308) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:17.109424 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e48c6244-6e97-495e-8453-994665914a6f None None] Routers {'71ad6783-2e04-4eb2-b203-4974f765b8e8'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:10:17.110063 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-e48c6244-6e97-495e-8453-994665914a6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:09:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['71ad6783-2e04-4eb2-b203-4974f765b8e8'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:17.224302 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-e48c6244-6e97-495e-8453-994665914a6f None None] Set router 71ad6783-2e04-4eb2-b203-4974f765b8e8 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:10:17.280230 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Notify callbacks [] for router, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.336824 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-08beaa75-b6b9-4a6d-a0c5-57e646d9707f req-1f7c9427-bd22-4efc-ad61-7fe1677e2f76 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] For port c163baa9-83ec-4da5-a79e-088fea86e5c9, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:17.405525 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-08beaa75-b6b9-4a6d-a0c5-57e646d9707f req-1f7c9427-bd22-4efc-ad61-7fe1677e2f76 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for port, precommit_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.405992 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-e48c6244-6e97-495e-8453-994665914a6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'name': 'tempest-TestVolumeBootPattern-99759354-router', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78'}], 'enable_snat': True}, 'gw_port_id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:11Z', 'updated_at': '2021-08-24T03:10:16Z', 'revision_number': 5, 'project_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'gw_port': {'id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:77:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:12Z', 'updated_at': '2021-08-24T03:02:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:17.419466 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.432084 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e48c6244-6e97-495e-8453-994665914a6f None None] Checking router: 71ad6783-2e04-4eb2-b203-4974f765b8e8 for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:10:17.441016 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e48c6244-6e97-495e-8453-994665914a6f None None] Routers {'71ad6783-2e04-4eb2-b203-4974f765b8e8'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:10:17.441634 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-e48c6244-6e97-495e-8453-994665914a6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:09:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['71ad6783-2e04-4eb2-b203-4974f765b8e8'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:17.474120 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-08beaa75-b6b9-4a6d-a0c5-57e646d9707f req-1f7c9427-bd22-4efc-ad61-7fe1677e2f76 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732364332108', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732363811063', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732363808269', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-3525743'] for port, after_update {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.486063 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['c163baa9-83ec-4da5-a79e-088fea86e5c9'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:10:17.540064 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08beaa75-b6b9-4a6d-a0c5-57e646d9707f req-1f7c9427-bd22-4efc-ad61-7fe1677e2f76 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:17.540703 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-08beaa75-b6b9-4a6d-a0c5-57e646d9707f req-1f7c9427-bd22-4efc-ad61-7fe1677e2f76 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.542317 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-08beaa75-b6b9-4a6d-a0c5-57e646d9707f req-1f7c9427-bd22-4efc-ad61-7fe1677e2f76 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "PUT /v2.0/ports/c163baa9-83ec-4da5-a79e-088fea86e5c9 HTTP/1.1" status: 200 len: 942 time: 0.6722105 Aug 24 03:10:17.543735 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:10:17.546279 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-38cdbf6e-54ea-414b-ad1a-78c8c3bb6ff9" -d '{"events": [{"name": "network-changed", "server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:10:17.549430 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42312) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:17.558714 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-e48c6244-6e97-495e-8453-994665914a6f None None] Set router 71ad6783-2e04-4eb2-b203-4974f765b8e8 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:10:17.573897 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f7c9427-bd22-4efc-ad61-7fe1677e2f76 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event updated for resources: {'Port': ['ID=c163baa9-83ec-4da5-a79e-088fea86e5c9,revision_number=7']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:17.599807 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Deleting port 984621a4-5382-4c35-8a6e-b1485ece36ab {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:17.600249 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.626990 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:10:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed61cd36-e1be-4d02-afad-accbf16c7af1 x-openstack-request-id: req-ed61cd36-e1be-4d02-afad-accbf16c7af1 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:10:17.627637 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:10:17.627752 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-ed61cd36-e1be-4d02-afad-accbf16c7af1 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:10:17.628237 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'status': 'completed', 'code': 200} Aug 24 03:10:17.691972 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['c163baa9-83ec-4da5-a79e-088fea86e5c9'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:10:17.703576 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-50238f15-0e46-4b69-b203-5a077a614f57 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.752098 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-50238f15-0e46-4b69-b203-5a077a614f57 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.769175 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38cdbf6e-54ea-414b-ad1a-78c8c3bb6ff9 req-20a8e49b-082e-4682-9731-e7fb115b0888 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:17.771002 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-38cdbf6e-54ea-414b-ad1a-78c8c3bb6ff9 req-20a8e49b-082e-4682-9731-e7fb115b0888 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=a74f1fd1896c4ed09ff280398fa2440f&device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 1098 time: 0.0913925 Aug 24 03:10:17.778571 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] For port 984621a4-5382-4c35-8a6e-b1485ece36ab, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=984621a4-5382-4c35-8a6e-b1485ece36ab,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:17.779059 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.822826 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-e48c6244-6e97-495e-8453-994665914a6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'name': 'tempest-TestVolumeBootPattern-99759354-router', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78'}], 'enable_snat': True}, 'gw_port_id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:11Z', 'updated_at': '2021-08-24T03:10:16Z', 'revision_number': 5, 'project_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'gw_port': {'id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:77:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:12Z', 'updated_at': '2021-08-24T03:02:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:17.825217 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.provisioning_blocks [None req-9ddf628a-224a-4ae7-9512-f1f73d8de1cc None None] Provisioning complete for port c163baa9-83ec-4da5-a79e-088fea86e5c9 triggered by entity DHCP. {{(pid=111277) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Aug 24 03:10:17.825619 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9ddf628a-224a-4ae7-9512-f1f73d8de1cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-16201643'] for port, provisioning_complete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.836269 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Calling delete_port for 984621a4-5382-4c35-8a6e-b1485ece36ab owned by network:router_gateway {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:17.855135 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e48c6244-6e97-495e-8453-994665914a6f None None] The sync data for ids ['71ad6783-2e04-4eb2-b203-4974f765b8e8'] in dv-cinder-803748-8-iscsi is: [{'id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'name': 'tempest-TestVolumeBootPattern-99759354-router', 'tenant_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78'}], 'enable_snat': True}, 'gw_port_id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:02:11Z', 'updated_at': '2021-08-24T03:10:16Z', 'revision_number': 5, 'project_id': '3cbdbe4be9884f938ca1bbfbe2d22f34', 'gw_port': {'id': '984621a4-5382-4c35-8a6e-b1485ece36ab', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:61:77:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71ad6783-2e04-4eb2-b203-4974f765b8e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:02:12Z', 'updated_at': '2021-08-24T03:02:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:10:17.966412 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-50238f15-0e46-4b69-b203-5a077a614f57 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.970558 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-50238f15-0e46-4b69-b203-5a077a614f57 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:17.972312 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-50238f15-0e46-4b69-b203-5a077a614f57 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "DELETE /v2.0/security-groups/ea9c22ab-a6b2-4c54-b7bf-3726f9559967 HTTP/1.1" status: 204 len: 168 time: 0.4217355 Aug 24 03:10:17.977524 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42314) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:17.996290 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50238f15-0e46-4b69-b203-5a077a614f57 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea9c22ab-a6b2-4c54-b7bf-3726f9559967,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:18.156303 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Deleting port e6d758d4-f703-4081-b578-7bd457209206 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:18.156920 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:18.199696 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38cdbf6e-54ea-414b-ad1a-78c8c3bb6ff9 req-233536cc-585a-4661-9fc0-b4466732f502 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:18.201570 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-38cdbf6e-54ea-414b-ad1a-78c8c3bb6ff9 req-233536cc-585a-4661-9fc0-b4466732f502 service neutron] 10.222.0.43 "GET /v2.0/networks?id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b HTTP/1.1" status: 200 len: 916 time: 0.4195004 Aug 24 03:10:18.234706 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:18.235034 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:18.247643 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Calling delete_port for e6d758d4-f703-4081-b578-7bd457209206 owned by network:floatingip {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:18.310003 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-38cdbf6e-54ea-414b-ad1a-78c8c3bb6ff9 req-5c14563e-5e49-40d8-ae2c-7b3084119b6c service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9 HTTP/1.1" status: 200 len: 1000 time: 0.1005666 Aug 24 03:10:18.392742 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38cdbf6e-54ea-414b-ad1a-78c8c3bb6ff9 req-58f78116-495e-4519-920c-63bd802ac16a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:18.394350 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-38cdbf6e-54ea-414b-ad1a-78c8c3bb6ff9 req-58f78116-495e-4519-920c-63bd802ac16a service neutron] 10.222.0.43 "GET /v2.0/subnets?id=f42fa902-0e1e-4185-b486-54648ea18f14 HTTP/1.1" status: 200 len: 854 time: 0.0755939 Aug 24 03:10:18.439563 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:18.457335 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:18.469696 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38cdbf6e-54ea-414b-ad1a-78c8c3bb6ff9 req-83421ed8-5ad7-46cb-8e9a-3af81bf9ea7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:18.471266 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-38cdbf6e-54ea-414b-ad1a-78c8c3bb6ff9 req-83421ed8-5ad7-46cb-8e9a-3af81bf9ea7a service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0699880 Aug 24 03:10:18.473307 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Pushing event deleted for resources: {'Port': ['ID=984621a4-5382-4c35-8a6e-b1485ece36ab,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:18.483774 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event deleted for resources: {'Port': ['ID=e6d758d4-f703-4081-b578-7bd457209206,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:18.544019 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks [] for floatingip, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:18.544327 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.db.l3_db [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Floating IP bfa11141-0b33-4f99-8199-2e2cbe8e8b7f disassociated (deleted). External IP: 172.27.2.86, port: c163baa9-83ec-4da5-a79e-088fea86e5c9. Aug 24 03:10:18.594303 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-569567'] for router_gateway, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:18.669246 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-38cdbf6e-54ea-414b-ad1a-78c8c3bb6ff9 req-e341d559-1f52-4c2f-8838-55833f05ae27 service neutron] 10.222.0.43 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1901927 Aug 24 03:10:18.705550 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-560207', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32699'] for router, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:18.715804 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:18.747654 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:10:18.818970 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-38cdbf6e-54ea-414b-ad1a-78c8c3bb6ff9 req-c81d9c89-b8eb-48a0-a157-cb5bb8346e35 service neutron] 10.222.0.43 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1238849 Aug 24 03:10:18.853356 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:10:18.858155 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for floatingip, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:18.863108 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d21283c5-8249-44fd-860f-a862ddc7b7f4 None None] Sync routers for ids ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:10:18.872390 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d21283c5-8249-44fd-860f-a862ddc7b7f4 None None] Routers {'e1d42a7b-c203-472f-94cb-e31f4ffab5c6'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:10:18.873002 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-d21283c5-8249-44fd-860f-a862ddc7b7f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:09:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:18.884621 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-03822bb7-f4d5-4eac-a1f8-c98090b5df7f tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "DELETE /v2.0/floatingips/bfa11141-0b33-4f99-8199-2e2cbe8e8b7f HTTP/1.1" status: 204 len: 168 time: 0.9031444 Aug 24 03:10:18.885212 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9'}] {{(pid=111275) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:10:18.887780 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53c43dbdeda65d00e86da8ad5c6558e921b14d3926e21409b6524e4d38b98a9f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-364d0332-bb05-4488-b6cd-4830751502ab" -d '{"events": [{"name": "network-changed", "server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9"}]}' {{(pid=111275) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:10:18.890995 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557756'] for router, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:18.891711 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 71ad6783-2e04-4eb2-b203-4974f765b8e8 {{(pid=111276) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Aug 24 03:10:18.899505 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] Notify callbacks [] for router, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:18.903204 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-bfd6e441-df2f-4877-8424-26e50b1832f8 admin admin] 10.222.0.30 "DELETE /v2.0/routers/71ad6783-2e04-4eb2-b203-4974f765b8e8 HTTP/1.1" status: 204 len: 168 time: 1.7991049 Aug 24 03:10:18.903586 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42320) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:18.950185 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 24 Aug 2021 03:10:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-282248c6-e21a-40f0-8a34-e78ed016d97c x-openstack-request-id: req-282248c6-e21a-40f0-8a34-e78ed016d97c {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:10:18.950567 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9", "status": "completed", "code": 200}]} {{(pid=111275) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:10:18.951408 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-282248c6-e21a-40f0-8a34-e78ed016d97c {{(pid=111275) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:10:18.951408 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'status': 'completed', 'code': 200} Aug 24 03:10:18.960841 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-2fffd847-e7fb-4b35-bf31-b0f8240d76a9 admin admin] Deleting subnet 4b7095fd-e503-473e-b61b-354e0711f169 {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:10:18.965663 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2fffd847-e7fb-4b35-bf31-b0f8240d76a9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:19.004518 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2fffd847-e7fb-4b35-bf31-b0f8240d76a9 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:19.033015 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-d21283c5-8249-44fd-860f-a862ddc7b7f4 None None] Set router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:10:19.054697 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-364d0332-bb05-4488-b6cd-4830751502ab req-08bae8e4-0554-449c-ade2-dafe65b16391 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:19.057403 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-364d0332-bb05-4488-b6cd-4830751502ab req-08bae8e4-0554-449c-ade2-dafe65b16391 service neutron] 10.222.0.43 "GET /v2.0/ports?tenant_id=a74f1fd1896c4ed09ff280398fa2440f&device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 1098 time: 0.0747585 Aug 24 03:10:19.116287 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2fffd847-e7fb-4b35-bf31-b0f8240d76a9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:19.208987 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-364d0332-bb05-4488-b6cd-4830751502ab req-c22196c1-f8d6-43e4-88fb-257561385475 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:19.210509 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-364d0332-bb05-4488-b6cd-4830751502ab req-c22196c1-f8d6-43e4-88fb-257561385475 service neutron] 10.222.0.43 "GET /v2.0/networks?id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b HTTP/1.1" status: 200 len: 916 time: 0.1453452 Aug 24 03:10:19.248962 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2fffd847-e7fb-4b35-bf31-b0f8240d76a9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:19.257640 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-364d0332-bb05-4488-b6cd-4830751502ab req-897c91e4-c981-45b5-a7b1-078120dfb222 service neutron] 10.222.0.43 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9 HTTP/1.1" status: 200 len: 217 time: 0.0377274 Aug 24 03:10:19.268869 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-2fffd847-e7fb-4b35-bf31-b0f8240d76a9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:19.274370 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-2fffd847-e7fb-4b35-bf31-b0f8240d76a9 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/4b7095fd-e503-473e-b61b-354e0711f169 HTTP/1.1" status: 204 len: 168 time: 0.3696878 Aug 24 03:10:19.279269 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42326) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:19.280105 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95b8c115-f8b3-45dd-b2a4-4e1d98df2e31 None None] Network 13c627dc-b4e4-4312-bbc3-d825db999a37 requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:10:19.282687 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 9965b4e1-c80d-431e-9f19-6ebd3262cd07 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:19.305938 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fffd847-e7fb-4b35-bf31-b0f8240d76a9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4b7095fd-e503-473e-b61b-354e0711f169,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:19.318358 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: 9965b4e1-c80d-431e-9f19-6ebd3262cd07 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:19.318834 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 9965b4e1-c80d-431e-9f19-6ebd3262cd07 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:19.374080 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-d21283c5-8249-44fd-860f-a862ddc7b7f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 4, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'ed6e0056-5b12-4208-94e0-7ff36c2102a7', 'name': '', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'mac_address': 'fa:16:3e:97:c7:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_interface', 'standard_attr_id': 641, 'fixed_ips': [{'subnet_id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:10Z', 'updated_at': '2021-08-24T03:08:16Z', 'revision_number': 5, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'subnets': [{'id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:19.392142 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-364d0332-bb05-4488-b6cd-4830751502ab req-7ba6abe1-e35e-4f48-8428-03ed62ba37c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:19.393662 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-364d0332-bb05-4488-b6cd-4830751502ab req-7ba6abe1-e35e-4f48-8428-03ed62ba37c9 service neutron] 10.222.0.43 "GET /v2.0/subnets?id=f42fa902-0e1e-4185-b486-54648ea18f14 HTTP/1.1" status: 200 len: 854 time: 0.1291018 Aug 24 03:10:19.397800 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:19.403858 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d21283c5-8249-44fd-860f-a862ddc7b7f4 None None] Checking router: e1d42a7b-c203-472f-94cb-e31f4ffab5c6 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:10:19.433111 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d21283c5-8249-44fd-860f-a862ddc7b7f4 None None] Routers {'e1d42a7b-c203-472f-94cb-e31f4ffab5c6'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:10:19.438187 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-d21283c5-8249-44fd-860f-a862ddc7b7f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:09:54Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:19.469843 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-364d0332-bb05-4488-b6cd-4830751502ab req-4b696475-e551-43dd-b225-6f055692731d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:19.471337 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-364d0332-bb05-4488-b6cd-4830751502ab req-4b696475-e551-43dd-b225-6f055692731d service neutron] 10.222.0.43 "GET /v2.0/ports?network_id=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0700247 Aug 24 03:10:19.546306 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Deleting port aa09f096-8701-4649-8c74-e8883e55ee7e {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:19.546644 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:19.561092 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-d21283c5-8249-44fd-860f-a862ddc7b7f4 None None] Set router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:10:19.625603 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-364d0332-bb05-4488-b6cd-4830751502ab req-a1afc3a5-d91c-4d95-a74c-8b2663cebbd7 service neutron] 10.222.0.43 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1467450 Aug 24 03:10:19.632166 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] For port aa09f096-8701-4649-8c74-e8883e55ee7e, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=aa09f096-8701-4649-8c74-e8883e55ee7e,segment=NetworkSegment(7f24683c-fde3-41b9-a14e-aac1a7e5eb69),segment_id=7f24683c-fde3-41b9-a14e-aac1a7e5eb69)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:19.632526 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:19.641195 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] DHCP port deletion for 13c627dc-b4e4-4312-bbc3-d825db999a37 request from dv-cinder-803748-8-iscsi {{(pid=111277) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Aug 24 03:10:19.655449 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Calling delete_port for aa09f096-8701-4649-8c74-e8883e55ee7e owned by network:dhcp {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:19.775121 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Deleting port aa09f096-8701-4649-8c74-e8883e55ee7e {{(pid=111277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:19.775941 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:19.785016 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-364d0332-bb05-4488-b6cd-4830751502ab req-0c222b75-c191-41be-9b8d-a694fb586411 service neutron] 10.222.0.43 "GET /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1385310 Aug 24 03:10:19.849173 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] For port aa09f096-8701-4649-8c74-e8883e55ee7e, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=aa09f096-8701-4649-8c74-e8883e55ee7e,segment=NetworkSegment(7f24683c-fde3-41b9-a14e-aac1a7e5eb69),segment_id=7f24683c-fde3-41b9-a14e-aac1a7e5eb69)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:19.849464 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:19.903049 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:19.936541 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Pushing event deleted for resources: {'Port': ['ID=aa09f096-8701-4649-8c74-e8883e55ee7e,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:19.942773 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] No DVR routers for this DVR port aa09f096-8701-4649-8c74-e8883e55ee7e on host dv-cinder-803748-8-iscsi {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:10:19.988275 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Calling delete_port for aa09f096-8701-4649-8c74-e8883e55ee7e owned by network:dhcp {{(pid=111277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:20.006607 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-d21283c5-8249-44fd-860f-a862ddc7b7f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 4, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'ed6e0056-5b12-4208-94e0-7ff36c2102a7', 'name': '', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'mac_address': 'fa:16:3e:97:c7:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_interface', 'standard_attr_id': 641, 'fixed_ips': [{'subnet_id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:10Z', 'updated_at': '2021-08-24T03:08:16Z', 'revision_number': 5, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'subnets': [{'id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:20.019974 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:20.029819 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['13c627dc-b4e4-4312-bbc3-d825db999a37']}} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:20.039774 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7f24683c-fde3-41b9-a14e-aac1a7e5eb69') {'for_net_delete': True} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:20.040066 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.services.segments.db [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7f24683c-fde3-41b9-a14e-aac1a7e5eb69') {} {{(pid=111276) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:20.049880 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25761368'] for segment, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:20.059024 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d21283c5-8249-44fd-860f-a862ddc7b7f4 None None] The sync data for ids ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'] in dv-cinder-803748-8-iscsi is: [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:10Z', 'revision_number': 4, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi', '_interfaces': [{'id': 'ed6e0056-5b12-4208-94e0-7ff36c2102a7', 'name': '', 'network_id': 'ae628e21-d19e-4dd7-aa51-fd72f4db7e1b', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'mac_address': 'fa:16:3e:97:c7:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_interface', 'standard_attr_id': 641, 'fixed_ips': [{'subnet_id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:10Z', 'updated_at': '2021-08-24T03:08:16Z', 'revision_number': 5, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'subnets': [{'id': 'f42fa902-0e1e-4185-b486-54648ea18f14', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:10:20.066553 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:20.072907 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Releasing vlan 365 on physical network physnet1 to pool {{(pid=111276) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3525699'] for segment, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: Traceback (most recent call last): Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: timer() Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: cb(*args, **kw) Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: return func(*args, **kwargs) Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: self._notify() Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: self.callback(batched_events) Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: event.method(event) Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: return f(self, *a, **k) Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._get(url).json() Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: return self.request(url, 'GET', **kwargs) Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:10:20.079468 dv-cinder-803748-8-iscsi neutron-server[111276]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:10:20.098371 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054'] for port, after_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:20.129000 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Pushing event deleted for resources: {'Port': ['ID=aa09f096-8701-4649-8c74-e8883e55ee7e,revision_number=None']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:20.133756 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] No DVR routers for this DVR port aa09f096-8701-4649-8c74-e8883e55ee7e on host dv-cinder-803748-8-iscsi {{(pid=111277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:10:20.146535 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:10:20.149125 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:10:20.149125 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:10:20.149125 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:10:20.149125 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:10:20.149125 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:10:20.149125 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:10:20.149125 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:10:20.149805 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:10:20.149984 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:10:20.150301 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:10:20.150620 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b20bd2b8-4a90-4e9e-bebb-bc3d9b6834d0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-803748-8-iscsi {{(pid=111277) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Aug 24 03:10:20.194481 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:20.208634 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:20.208634 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] 10.222.0.30 "DELETE /v2.0/networks/13c627dc-b4e4-4312-bbc3-d825db999a37 HTTP/1.1" status: 204 len: 168 time: 0.9222665 Aug 24 03:10:20.214176 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8242bfb7-9e73-4f22-81cf-7f71ec50722c admin admin] Pushing event deleted for resources: {'Network': ['ID=13c627dc-b4e4-4312-bbc3-d825db999a37,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:20.332068 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b2a3564-fa85-470c-879c-2ac493059b91 None None] New status for floating IP bfa11141-0b33-4f99-8199-2e2cbe8e8b7f: DOWN {{(pid=111278) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Aug 24 03:10:20.536694 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42340) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:20.577346 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-083046fe-a19b-43a3-9225-f687fba5845c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=03198f839b864099b1c011c0fc54c7dd&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0395024 Aug 24 03:10:20.579834 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42342) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:20.627661 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d6aef2de-33e3-4f92-88df-a623aef7c6c9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:20.649042 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d6aef2de-33e3-4f92-88df-a623aef7c6c9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:20.776741 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d6aef2de-33e3-4f92-88df-a623aef7c6c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:20.779327 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-d6aef2de-33e3-4f92-88df-a623aef7c6c9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:20.780478 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-d6aef2de-33e3-4f92-88df-a623aef7c6c9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/03c01284-7898-44dd-b693-b74d809408d3 HTTP/1.1" status: 204 len: 168 time: 0.1997652 Aug 24 03:10:20.796297 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6aef2de-33e3-4f92-88df-a623aef7c6c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03c01284-7898-44dd-b693-b74d809408d3,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:21.228037 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device aa09f096-8701-4649-8c74-e8883e55ee7e no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:21.248035 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: aa09f096-8701-4649-8c74-e8883e55ee7e {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:21.248379 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device aa09f096-8701-4649-8c74-e8883e55ee7e not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:21.248782 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 984621a4-5382-4c35-8a6e-b1485ece36ab no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:21.266860 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: 984621a4-5382-4c35-8a6e-b1485ece36ab {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:21.267573 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 984621a4-5382-4c35-8a6e-b1485ece36ab not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:21.394064 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-25d490f9-885b-482e-b4fd-4d5a070dc3e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:21.495834 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42350) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:21.534607 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-3eef16f9-843b-47ec-a642-6838e91e23bc admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=3cbdbe4be9884f938ca1bbfbe2d22f34&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0375371 Aug 24 03:10:21.536852 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42352) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:21.583771 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-793df852-ce82-4c4d-b1b4-d278d0c9eb8c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:21.604853 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-793df852-ce82-4c4d-b1b4-d278d0c9eb8c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:21.723712 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-793df852-ce82-4c4d-b1b4-d278d0c9eb8c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:21.726326 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-793df852-ce82-4c4d-b1b4-d278d0c9eb8c admin admin] Notify callbacks [] for security_group, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:21.728388 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-793df852-ce82-4c4d-b1b4-d278d0c9eb8c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/371b3216-bbc7-405e-9569-4ba898577aaf HTTP/1.1" status: 204 len: 168 time: 0.1901152 Aug 24 03:10:21.739814 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-793df852-ce82-4c4d-b1b4-d278d0c9eb8c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=371b3216-bbc7-405e-9569-4ba898577aaf,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:22.229529 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e235f8-202f-46b2-90cb-24b2f5e6a7c3 req-bbf98276-3857-4202-8caa-a74c6f6b6ea2 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111275) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:22.231975 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-66e235f8-202f-46b2-90cb-24b2f5e6a7c3 req-bbf98276-3857-4202-8caa-a74c6f6b6ea2 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 945 time: 0.0519121 Aug 24 03:10:22.269538 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [req-66e235f8-202f-46b2-90cb-24b2f5e6a7c3 req-abee8561-e7f4-4244-a4a4-38417296b3c8 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313764 Aug 24 03:10:23.383775 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f0434b-f988-42b2-8a37-6469ae3c03e6 req-2bf96e4c-0786-441d-b47c-132a73bb49c9 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:23.385132 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d2f0434b-f988-42b2-8a37-6469ae3c03e6 req-2bf96e4c-0786-441d-b47c-132a73bb49c9 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 945 time: 0.0475941 Aug 24 03:10:23.422241 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-d2f0434b-f988-42b2-8a37-6469ae3c03e6 req-13b89818-f9a1-460d-b9f3-8e4c6bdb6053 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/security-groups?id=9abe615f-f88c-4d6c-97fa-2384752d2c4b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0307853 Aug 24 03:10:23.839968 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a259af4e-1641-4398-8bb5-2a6185b3627e req-95a107ec-f4c2-42d4-92b0-2b2b087fe569 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=111276) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Aug 24 03:10:23.841380 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a259af4e-1641-4398-8bb5-2a6185b3627e req-95a107ec-f4c2-42d4-92b0-2b2b087fe569 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.43 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 945 time: 0.0504823 Aug 24 03:10:23.934473 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-a259af4e-1641-4398-8bb5-2a6185b3627e req-8b6c2d90-7e40-41af-9037-328455b0666b tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Deleting port c163baa9-83ec-4da5-a79e-088fea86e5c9 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:23.934735 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-a259af4e-1641-4398-8bb5-2a6185b3627e req-8b6c2d90-7e40-41af-9037-328455b0666b tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:23.993247 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-722c6875-2a12-42cb-8dc1-81034fee8c03 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:24.026688 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [req-a259af4e-1641-4398-8bb5-2a6185b3627e req-8b6c2d90-7e40-41af-9037-328455b0666b tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] For port c163baa9-83ec-4da5-a79e-088fea86e5c9, host hv-cinder-80374, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80374',level=0,port_id=c163baa9-83ec-4da5-a79e-088fea86e5c9,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:24.027061 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-a259af4e-1641-4398-8bb5-2a6185b3627e req-8b6c2d90-7e40-41af-9037-328455b0666b tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:24.038486 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [req-a259af4e-1641-4398-8bb5-2a6185b3627e req-8b6c2d90-7e40-41af-9037-328455b0666b tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Calling delete_port for c163baa9-83ec-4da5-a79e-088fea86e5c9 owned by compute:nova {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:24.222227 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-a259af4e-1641-4398-8bb5-2a6185b3627e req-8b6c2d90-7e40-41af-9037-328455b0666b tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:24.233521 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] get_ports_and_sgs() called for port_ids ['c163baa9-83ec-4da5-a79e-088fea86e5c9'] {{(pid=111277) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Aug 24 03:10:24.255759 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b6c2d90-7e40-41af-9037-328455b0666b tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Pushing event deleted for resources: {'Port': ['ID=c163baa9-83ec-4da5-a79e-088fea86e5c9,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:24.295697 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.db.l3_dvrscheduler_db [req-a259af4e-1641-4398-8bb5-2a6185b3627e req-8b6c2d90-7e40-41af-9037-328455b0666b tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] No DVR routers for this DVR port c163baa9-83ec-4da5-a79e-088fea86e5c9 on host hv-cinder-80374 {{(pid=111276) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:10:24.299314 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [req-a259af4e-1641-4398-8bb5-2a6185b3627e req-8b6c2d90-7e40-41af-9037-328455b0666b tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-42925'] for port, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:24.300267 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a259af4e-1641-4398-8bb5-2a6185b3627e req-8b6c2d90-7e40-41af-9037-328455b0666b tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.43 "DELETE /v2.0/ports/c163baa9-83ec-4da5-a79e-088fea86e5c9 HTTP/1.1" status: 204 len: 173 time: 0.4512990 Aug 24 03:10:24.300697 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'name': 'network-vif-deleted', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9'}] {{(pid=111276) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Aug 24 03:10:24.302969 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.30/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0775344dbce6b94f522c0570ef4fedb360c7558ba02b929aeeb33d5dba069d53" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-beeb43b0-d36d-4731-a272-db81a22a20e5" -d '{"events": [{"server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "name": "network-vif-deleted", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9"}]}' {{(pid=111276) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Aug 24 03:10:24.336355 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 24 Aug 2021 03:10:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7fc918ab-ed3b-4f71-91cd-d83c58bf9aa0 x-openstack-request-id: req-7fc918ab-ed3b-4f71-91cd-d83c58bf9aa0 {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Aug 24 03:10:24.336646 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "95e65125-3e9f-477e-93cc-b0762249f60d", "name": "network-vif-deleted", "tag": "c163baa9-83ec-4da5-a79e-088fea86e5c9", "status": "completed", "code": 200}]} {{(pid=111276) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Aug 24 03:10:24.336899 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.30/compute/v2.1/os-server-external-events used request id req-7fc918ab-ed3b-4f71-91cd-d83c58bf9aa0 {{(pid=111276) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Aug 24 03:10:24.337293 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '95e65125-3e9f-477e-93cc-b0762249f60d', 'name': 'network-vif-deleted', 'tag': 'c163baa9-83ec-4da5-a79e-088fea86e5c9', 'status': 'completed', 'code': 200} Aug 24 03:10:24.347992 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:24.517294 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [req-a4fb859c-bcde-45c6-86bf-29a5630bae03 req-57d53442-05d8-4a4a-9588-6358c640c8e6 tempest-TestMinimumBasicScenario-864281296 tempest-TestMinimumBasicScenario-864281296-project] 10.222.0.30 "GET /v2.0/ports?device_id=95e65125-3e9f-477e-93cc-b0762249f60d HTTP/1.1" status: 200 len: 210 time: 0.0286632 Aug 24 03:10:25.599390 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:26.999930 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:27.029327 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42408) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:27.366025 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-701cefda-4d60-4d11-9a58-64af78e9dda9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-566649'] for router_interface, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:27.602708 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-701cefda-4d60-4d11-9a58-64af78e9dda9 admin admin] Deleting port ed6e0056-5b12-4208-94e0-7ff36c2102a7 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:27.603039 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-701cefda-4d60-4d11-9a58-64af78e9dda9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:27.677892 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-701cefda-4d60-4d11-9a58-64af78e9dda9 admin admin] For port ed6e0056-5b12-4208-94e0-7ff36c2102a7, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=ed6e0056-5b12-4208-94e0-7ff36c2102a7,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:27.678253 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-701cefda-4d60-4d11-9a58-64af78e9dda9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:27.689732 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-701cefda-4d60-4d11-9a58-64af78e9dda9 admin admin] Calling delete_port for ed6e0056-5b12-4208-94e0-7ff36c2102a7 owned by network:router_interface {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:27.942987 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-701cefda-4d60-4d11-9a58-64af78e9dda9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:27.971411 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-701cefda-4d60-4d11-9a58-64af78e9dda9 admin admin] Pushing event deleted for resources: {'Port': ['ID=ed6e0056-5b12-4208-94e0-7ff36c2102a7,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:28.133299 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-701cefda-4d60-4d11-9a58-64af78e9dda9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-748285', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-566109'] for router_interface, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:28.292940 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device c163baa9-83ec-4da5-a79e-088fea86e5c9 no longer exists at agent hyperv_hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:28.317349 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] No Port match for: c163baa9-83ec-4da5-a79e-088fea86e5c9 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:28.317797 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Device c163baa9-83ec-4da5-a79e-088fea86e5c9 not bound to the agent host hv-cinder-80374 {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:28.593510 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-701cefda-4d60-4d11-9a58-64af78e9dda9 admin admin] Router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111275) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:10:28.697080 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-701cefda-4d60-4d11-9a58-64af78e9dda9 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111275) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:10:28.702842 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-701cefda-4d60-4d11-9a58-64af78e9dda9 admin admin] 10.222.0.30 "PUT /v2.0/routers/e1d42a7b-c203-472f-94cb-e31f4ffab5c6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6723983 Aug 24 03:10:28.705443 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42410) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:28.709718 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f46efb7b-4a5a-4e7e-93c9-c8cf22204ad1 None None] Sync routers for ids ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'] in dv-cinder-803748-8-iscsi {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:10:28.718138 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f46efb7b-4a5a-4e7e-93c9-c8cf22204ad1 None None] Routers {'e1d42a7b-c203-472f-94cb-e31f4ffab5c6'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:10:28.718745 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-f46efb7b-4a5a-4e7e-93c9-c8cf22204ad1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:10:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:28.806930 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Notify callbacks [] for router, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:28.820556 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-f46efb7b-4a5a-4e7e-93c9-c8cf22204ad1 None None] Set router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 gateway port host: dv-cinder-803748-8-iscsi {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:10:28.905932 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:28.992667 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-f46efb7b-4a5a-4e7e-93c9-c8cf22204ad1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192'}], 'enable_snat': True}, 'gw_port_id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:10:27Z', 'revision_number': 5, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port': {'id': '76b67021-ef4b-4cc2-a84c-5373ca0abbb2', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:9e:cf:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 640, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.192', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:08:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:29.018688 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f46efb7b-4a5a-4e7e-93c9-c8cf22204ad1 None None] Checking router: e1d42a7b-c203-472f-94cb-e31f4ffab5c6 for host: dv-cinder-803748-8-iscsi {{(pid=111277) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:10:29.026985 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f46efb7b-4a5a-4e7e-93c9-c8cf22204ad1 None None] Routers {'e1d42a7b-c203-472f-94cb-e31f4ffab5c6'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111277) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:10:29.027595 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-f46efb7b-4a5a-4e7e-93c9-c8cf22204ad1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:10:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'], 'active': True} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:29.041625 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Deleting port 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:29.041964 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.113485 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvr_db [None req-f46efb7b-4a5a-4e7e-93c9-c8cf22204ad1 None None] Set router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 gateway port host: None {{(pid=111277) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:10:29.121342 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] For port 76b67021-ef4b-4cc2-a84c-5373ca0abbb2, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=76b67021-ef4b-4cc2-a84c-5373ca0abbb2,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:29.122374 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.134263 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Calling delete_port for 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 owned by network:router_gateway {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:29.166851 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_hamode_db [None req-f46efb7b-4a5a-4e7e-93c9-c8cf22204ad1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:10:28Z', 'revision_number': 6, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port_host': None}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111277) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:29.194102 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f46efb7b-4a5a-4e7e-93c9-c8cf22204ad1 None None] The sync data for ids ['e1d42a7b-c203-472f-94cb-e31f4ffab5c6'] in dv-cinder-803748-8-iscsi is: [{'id': 'e1d42a7b-c203-472f-94cb-e31f4ffab5c6', 'name': 'tempest-TestMinimumBasicScenario-1751136595-router', 'tenant_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:07Z', 'updated_at': '2021-08-24T03:10:28Z', 'revision_number': 6, 'project_id': 'a74f1fd1896c4ed09ff280398fa2440f', 'gw_port_host': None}] {{(pid=111277) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:10:29.352337 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.383563 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Pushing event deleted for resources: {'Port': ['ID=76b67021-ef4b-4cc2-a84c-5373ca0abbb2,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:29.440516 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-569567'] for router_gateway, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.526091 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-560207', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32699'] for router, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.528878 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.650723 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557756'] for router, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.651254 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Fanout notify agent at l3_agent the message router_deleted on router e1d42a7b-c203-472f-94cb-e31f4ffab5c6 {{(pid=111275) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Aug 24 03:10:29.656043 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] Notify callbacks [] for router, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.657170 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-71ccdaa4-13e0-4183-a6bc-41bd690f683e admin admin] 10.222.0.30 "DELETE /v2.0/routers/e1d42a7b-c203-472f-94cb-e31f4ffab5c6 HTTP/1.1" status: 204 len: 168 time: 0.9508429 Aug 24 03:10:29.659734 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42412) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:29.706749 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-99a3dfa4-bce5-46a4-a149-40416a4adf45 admin admin] Deleting subnet f42fa902-0e1e-4185-b486-54648ea18f14 {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:10:29.709646 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99a3dfa4-bce5-46a4-a149-40416a4adf45 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.741947 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99a3dfa4-bce5-46a4-a149-40416a4adf45 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.815835 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99a3dfa4-bce5-46a4-a149-40416a4adf45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.946601 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99a3dfa4-bce5-46a4-a149-40416a4adf45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.977184 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99a3dfa4-bce5-46a4-a149-40416a4adf45 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f42fa902-0e1e-4185-b486-54648ea18f14,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:29.979096 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-99a3dfa4-bce5-46a4-a149-40416a4adf45 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:29.982893 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-99a3dfa4-bce5-46a4-a149-40416a4adf45 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/f42fa902-0e1e-4185-b486-54648ea18f14 HTTP/1.1" status: 204 len: 168 time: 0.3203139 Aug 24 03:10:29.984964 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42414) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:29.987640 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbb55b73-48ea-4d70-a082-1d015fc1b63f None None] Network ae628e21-d19e-4dd7-aa51-fd72f4db7e1b requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:10:30.058411 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.114039 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Deleting port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:30.114382 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.179190 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db672f85-6e11-4d7f-9b32-b2370772691e None None] DHCP port deletion for ae628e21-d19e-4dd7-aa51-fd72f4db7e1b request from dv-cinder-803748-8-iscsi {{(pid=111277) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Aug 24 03:10:30.186492 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] For port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=8f7e065f-ade9-4562-a7d4-6fa0d38faa3b,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:30.187058 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.201328 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Calling delete_port for 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b owned by network:dhcp {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:30.227472 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-db672f85-6e11-4d7f-9b32-b2370772691e None None] Deleting port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b {{(pid=111277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:30.227789 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-db672f85-6e11-4d7f-9b32-b2370772691e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.292223 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-db672f85-6e11-4d7f-9b32-b2370772691e None None] For port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=8f7e065f-ade9-4562-a7d4-6fa0d38faa3b,segment=NetworkSegment(d71e524b-5651-4545-b1cf-eda4cfb942c6),segment_id=d71e524b-5651-4545-b1cf-eda4cfb942c6)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:30.292626 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-db672f85-6e11-4d7f-9b32-b2370772691e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.305307 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-db672f85-6e11-4d7f-9b32-b2370772691e None None] Calling delete_port for 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b owned by network:dhcp {{(pid=111277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:30.336322 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.362409 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Pushing event deleted for resources: {'Port': ['ID=8f7e065f-ade9-4562-a7d4-6fa0d38faa3b,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:30.364224 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] No DVR routers for this DVR port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b on host dv-cinder-803748-8-iscsi {{(pid=111275) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:10:30.379232 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-db672f85-6e11-4d7f-9b32-b2370772691e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054'] for port, after_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.404923 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db672f85-6e11-4d7f-9b32-b2370772691e None None] Pushing event deleted for resources: {'Port': ['ID=8f7e065f-ade9-4562-a7d4-6fa0d38faa3b,revision_number=None']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:30.408195 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db672f85-6e11-4d7f-9b32-b2370772691e None None] No DVR routers for this DVR port 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b on host dv-cinder-803748-8-iscsi {{(pid=111277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:10:30.437551 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.447114 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ae628e21-d19e-4dd7-aa51-fd72f4db7e1b']}} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:30.457438 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd71e524b-5651-4545-b1cf-eda4cfb942c6') {'for_net_delete': True} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:30.457762 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd71e524b-5651-4545-b1cf-eda4cfb942c6') {} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:30.466187 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25719248'] for segment, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.479066 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.485241 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Releasing vlan 350 on physical network physnet1 to pool {{(pid=111275) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:10:30.485654 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3484247'] for segment, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: Traceback (most recent call last): Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: timer() Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: cb(*args, **kw) Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: return func(*args, **kwargs) Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: self._notify() Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: self.callback(batched_events) Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: event.method(event) Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: return f(self, *a, **k) Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._get(url).json() Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: return self.request(url, 'GET', **kwargs) Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:10:30.487225 dv-cinder-803748-8-iscsi neutron-server[111275]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:10:30.616678 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.622662 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:30.624606 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] 10.222.0.30 "DELETE /v2.0/networks/ae628e21-d19e-4dd7-aa51-fd72f4db7e1b HTTP/1.1" status: 204 len: 168 time: 0.6386206 Aug 24 03:10:30.627611 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42416) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:30.635681 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c705c568-44df-4692-a3e6-dde0bcc43131 admin admin] Pushing event deleted for resources: {'Network': ['ID=ae628e21-d19e-4dd7-aa51-fd72f4db7e1b,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:30.968726 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-dcb2253e-a862-4331-988e-6ff5a7a40d49 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-566649'] for router_interface, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:31.207323 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-dcb2253e-a862-4331-988e-6ff5a7a40d49 admin admin] Deleting port acbc4b29-2d6f-4171-ac20-407f3fef3906 {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:31.207667 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-dcb2253e-a862-4331-988e-6ff5a7a40d49 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:31.241312 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:31.264609 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:31.264956 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 76b67021-ef4b-4cc2-a84c-5373ca0abbb2 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:31.265356 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:31.283319 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:31.283663 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 8f7e065f-ade9-4562-a7d4-6fa0d38faa3b not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:31.283874 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [None req-dcb2253e-a862-4331-988e-6ff5a7a40d49 admin admin] For port acbc4b29-2d6f-4171-ac20-407f3fef3906, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=acbc4b29-2d6f-4171-ac20-407f3fef3906,segment=NetworkSegment(4008e385-fd85-46e6-ae27-b19d14c888fd),segment_id=4008e385-fd85-46e6-ae27-b19d14c888fd)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:31.284067 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device ed6e0056-5b12-4208-94e0-7ff36c2102a7 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:31.284253 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-dcb2253e-a862-4331-988e-6ff5a7a40d49 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:31.296163 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-dcb2253e-a862-4331-988e-6ff5a7a40d49 admin admin] Calling delete_port for acbc4b29-2d6f-4171-ac20-407f3fef3906 owned by network:router_interface {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:31.302719 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: ed6e0056-5b12-4208-94e0-7ff36c2102a7 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:31.303061 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device ed6e0056-5b12-4208-94e0-7ff36c2102a7 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:31.536100 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-dcb2253e-a862-4331-988e-6ff5a7a40d49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:31.563939 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcb2253e-a862-4331-988e-6ff5a7a40d49 admin admin] Pushing event deleted for resources: {'Port': ['ID=acbc4b29-2d6f-4171-ac20-407f3fef3906,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:31.726446 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-dcb2253e-a862-4331-988e-6ff5a7a40d49 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-748285', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-566109'] for router_interface, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:32.191347 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dcb2253e-a862-4331-988e-6ff5a7a40d49 admin admin] Router b0ea82a6-cb14-437b-9500-710e02bccb2c has already been hosted by L3 agent c79f087a-032a-43c5-acfb-762cdbacea80 {{(pid=111276) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Aug 24 03:10:32.295332 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dcb2253e-a862-4331-988e-6ff5a7a40d49 admin admin] Notify agent at l3_agent.dv-cinder-803748-8-iscsi the message routers_updated {{(pid=111276) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Aug 24 03:10:32.300955 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-dcb2253e-a862-4331-988e-6ff5a7a40d49 admin admin] 10.222.0.30 "PUT /v2.0/routers/b0ea82a6-cb14-437b-9500-710e02bccb2c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6722672 Aug 24 03:10:32.303493 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.wsgi [-] (111276) accepted ('10.222.0.30', 42418) {{(pid=111276) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:32.304310 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65ea821b-8604-46c9-beba-29d0126133b3 None None] Sync routers for ids ['b0ea82a6-cb14-437b-9500-710e02bccb2c'] in dv-cinder-803748-8-iscsi {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Aug 24 03:10:32.314080 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65ea821b-8604-46c9-beba-29d0126133b3 None None] Routers {'b0ea82a6-cb14-437b-9500-710e02bccb2c'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:10:32.314684 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-65ea821b-8604-46c9-beba-29d0126133b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:10:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['b0ea82a6-cb14-437b-9500-710e02bccb2c'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:32.408477 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Notify callbacks [] for router, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:32.418325 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-65ea821b-8604-46c9-beba-29d0126133b3 None None] Set router b0ea82a6-cb14-437b-9500-710e02bccb2c gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:10:32.506108 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:32.589385 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-65ea821b-8604-46c9-beba-29d0126133b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'name': 'tempest-TestMinimumBasicScenario-349617832-router', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121'}], 'enable_snat': True}, 'gw_port_id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:14Z', 'updated_at': '2021-08-24T03:10:31Z', 'revision_number': 5, 'project_id': '849103eb110a4cd69c63067564c4696e', 'gw_port': {'id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:54:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:15Z', 'updated_at': '2021-08-24T03:08:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:32.617701 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65ea821b-8604-46c9-beba-29d0126133b3 None None] Checking router: b0ea82a6-cb14-437b-9500-710e02bccb2c for host: dv-cinder-803748-8-iscsi {{(pid=111278) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Aug 24 03:10:32.626461 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65ea821b-8604-46c9-beba-29d0126133b3 None None] Routers {'b0ea82a6-cb14-437b-9500-710e02bccb2c'} bound to L3 agent in host dv-cinder-803748-8-iscsi {{(pid=111278) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Aug 24 03:10:32.627090 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-65ea821b-8604-46c9-beba-29d0126133b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-803748-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-08-24T02:51:24Z,description=,heartbeat_timestamp=2021-08-24T03:10:24Z,host='dv-cinder-803748-8-iscsi',id=c79f087a-032a-43c5-acfb-762cdbacea80,load=0,resource_versions=,resources_synced=,started_at=2021-08-24T02:51:24Z,topic='l3_agent')) {'router_ids': ['b0ea82a6-cb14-437b-9500-710e02bccb2c'], 'active': True} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:32.715426 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Deleting port 35e488a7-bf51-48e0-a230-0481006d2fbb {{(pid=111276) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:32.715997 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:32.801319 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.db [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] For port 35e488a7-bf51-48e0-a230-0481006d2fbb, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=35e488a7-bf51-48e0-a230-0481006d2fbb,segment=NetworkSegment(14cb234e-5636-4a14-a6ad-467857ff59ba),segment_id=14cb234e-5636-4a14-a6ad-467857ff59ba)] {{(pid=111276) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:32.802033 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:32.813996 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.plugins.ml2.plugin [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Calling delete_port for 35e488a7-bf51-48e0-a230-0481006d2fbb owned by network:router_gateway {{(pid=111276) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:32.816407 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_dvr_db [None req-65ea821b-8604-46c9-beba-29d0126133b3 None None] Set router b0ea82a6-cb14-437b-9500-710e02bccb2c gateway port host: dv-cinder-803748-8-iscsi {{(pid=111278) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Aug 24 03:10:32.984852 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.l3_hamode_db [None req-65ea821b-8604-46c9-beba-29d0126133b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'name': 'tempest-TestMinimumBasicScenario-349617832-router', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121'}], 'enable_snat': True}, 'gw_port_id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:14Z', 'updated_at': '2021-08-24T03:10:31Z', 'revision_number': 5, 'project_id': '849103eb110a4cd69c63067564c4696e', 'gw_port': {'id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:54:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:15Z', 'updated_at': '2021-08-24T03:08:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}], 'dv-cinder-803748-8-iscsi', False) {} {{(pid=111278) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:33.010859 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65ea821b-8604-46c9-beba-29d0126133b3 None None] The sync data for ids ['b0ea82a6-cb14-437b-9500-710e02bccb2c'] in dv-cinder-803748-8-iscsi is: [{'id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'name': 'tempest-TestMinimumBasicScenario-349617832-router', 'tenant_id': '849103eb110a4cd69c63067564c4696e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'external_fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121'}], 'enable_snat': True}, 'gw_port_id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-08-24T03:08:14Z', 'updated_at': '2021-08-24T03:10:31Z', 'revision_number': 5, 'project_id': '849103eb110a4cd69c63067564c4696e', 'gw_port': {'id': '35e488a7-bf51-48e0-a230-0481006d2fbb', 'name': '', 'network_id': '63097abe-4b2c-457b-a244-629c1feb1fe5', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:54:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0ea82a6-cb14-437b-9500-710e02bccb2c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 664, 'fixed_ips': [{'subnet_id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'ip_address': '172.27.2.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-803748-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-08-24T03:08:15Z', 'updated_at': '2021-08-24T03:08:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f60a18ba-c7c4-4157-8bcb-1157d1d1b732', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-803748-8-iscsi'}] {{(pid=111278) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Aug 24 03:10:33.050095 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3525750'] for port, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.075939 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Pushing event deleted for resources: {'Port': ['ID=35e488a7-bf51-48e0-a230-0481006d2fbb,revision_number=None']} {{(pid=111276) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:33.138450 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-569567'] for router_gateway, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.225845 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-560207', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32699'] for router, precommit_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.227883 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.354018 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557756'] for router, after_delete {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.354597 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b0ea82a6-cb14-437b-9500-710e02bccb2c {{(pid=111276) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Aug 24 03:10:33.359718 dv-cinder-803748-8-iscsi neutron-server[111276]: DEBUG neutron_lib.callbacks.manager [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] Notify callbacks [] for router, before_response {{(pid=111276) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.361283 dv-cinder-803748-8-iscsi neutron-server[111276]: INFO neutron.wsgi [None req-ffbca50f-e65e-4cf9-9c9e-f1f3a3bbdf92 admin admin] 10.222.0.30 "DELETE /v2.0/routers/b0ea82a6-cb14-437b-9500-710e02bccb2c HTTP/1.1" status: 204 len: 168 time: 1.0567131 Aug 24 03:10:33.363809 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42420) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:33.414238 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.db_base_plugin_v2 [None req-a7fb8be8-b4fe-43d5-a65c-681c681f1aa3 admin admin] Deleting subnet 10284de2-ec04-40b4-850a-d25681a9249e {{(pid=111275) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Aug 24 03:10:33.419027 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7fb8be8-b4fe-43d5-a65c-681c681f1aa3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.455775 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7fb8be8-b4fe-43d5-a65c-681c681f1aa3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25719247'] for subnet, precommit_delete_associations {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.458671 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device acbc4b29-2d6f-4171-ac20-407f3fef3906 no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:33.479559 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: acbc4b29-2d6f-4171-ac20-407f3fef3906 {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:33.479906 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device acbc4b29-2d6f-4171-ac20-407f3fef3906 not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:33.539262 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7fb8be8-b4fe-43d5-a65c-681c681f1aa3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-16139737'] for subnet, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.679588 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7fb8be8-b4fe-43d5-a65c-681c681f1aa3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-16139734', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-594361', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-3484209', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3378688'] for subnet, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.706301 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7fb8be8-b4fe-43d5-a65c-681c681f1aa3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=10284de2-ec04-40b4-850a-d25681a9249e,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:33.709716 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-a7fb8be8-b4fe-43d5-a65c-681c681f1aa3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for subnet, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.711616 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-a7fb8be8-b4fe-43d5-a65c-681c681f1aa3 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/10284de2-ec04-40b4-850a-d25681a9249e HTTP/1.1" status: 204 len: 168 time: 0.3467479 Aug 24 03:10:33.714128 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42422) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:33.717606 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5eb09243-9731-43e0-965c-19212de8d80b None None] Network 0ea0c802-0090-450d-babb-4d8c5dbdbc8f requested from dv-cinder-803748-8-iscsi {{(pid=111277) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Aug 24 03:10:33.781303 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-16338997'] for network, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.840984 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Deleting port a2847c01-6cbd-41f7-a408-51b5059780df {{(pid=111275) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:33.841429 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.906671 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.db [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] For port a2847c01-6cbd-41f7-a408-51b5059780df, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=a2847c01-6cbd-41f7-a408-51b5059780df,segment=NetworkSegment(4008e385-fd85-46e6-ae27-b19d14c888fd),segment_id=4008e385-fd85-46e6-ae27-b19d14c888fd)] {{(pid=111275) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:33.907104 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:33.919350 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.plugin [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Calling delete_port for a2847c01-6cbd-41f7-a408-51b5059780df owned by network:dhcp {{(pid=111275) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:34.010469 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-957c2ac4-89d1-4578-bfb0-ea5908f84472 None None] DHCP port deletion for 0ea0c802-0090-450d-babb-4d8c5dbdbc8f request from dv-cinder-803748-8-iscsi {{(pid=111277) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Aug 24 03:10:34.057471 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-957c2ac4-89d1-4578-bfb0-ea5908f84472 None None] Deleting port a2847c01-6cbd-41f7-a408-51b5059780df {{(pid=111277) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1917}} Aug 24 03:10:34.057873 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-957c2ac4-89d1-4578-bfb0-ea5908f84472 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732364210180'] for port, before_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.068147 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-3484258'] for port, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.096285 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Pushing event deleted for resources: {'Port': ['ID=a2847c01-6cbd-41f7-a408-51b5059780df,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:34.100075 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] No DVR routers for this DVR port a2847c01-6cbd-41f7-a408-51b5059780df on host dv-cinder-803748-8-iscsi {{(pid=111275) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:10:34.124561 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.db [None req-957c2ac4-89d1-4578-bfb0-ea5908f84472 None None] For port a2847c01-6cbd-41f7-a408-51b5059780df, host dv-cinder-803748-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-803748-8-iscsi',level=0,port_id=a2847c01-6cbd-41f7-a408-51b5059780df,segment=NetworkSegment(4008e385-fd85-46e6-ae27-b19d14c888fd),segment_id=4008e385-fd85-46e6-ae27-b19d14c888fd)] {{(pid=111277) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Aug 24 03:10:34.130083 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-957c2ac4-89d1-4578-bfb0-ea5908f84472 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-566672'] for port, precommit_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.141969 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-957c2ac4-89d1-4578-bfb0-ea5908f84472 None None] Calling delete_port for a2847c01-6cbd-41f7-a408-51b5059780df owned by network:dhcp {{(pid=111277) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1995}} Aug 24 03:10:34.166466 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-16200226', 'neutron.services.segments.db._delete_segments_for_network-8732364279992'] for network, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.176606 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0ea0c802-0090-450d-babb-4d8c5dbdbc8f']}} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:34.187410 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4008e385-fd85-46e6-ae27-b19d14c888fd') {'for_net_delete': True} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:34.187707 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.services.segments.db [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4008e385-fd85-46e6-ae27-b19d14c888fd') {} {{(pid=111275) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Aug 24 03:10:34.196330 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732364358337', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25719248'] for segment, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.210182 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166'] for segment, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.215585 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-957c2ac4-89d1-4578-bfb0-ea5908f84472 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-16374286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1021600', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732364332090', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732363811054'] for port, after_delete {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.215934 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Releasing vlan 387 on physical network physnet1 to pool {{(pid=111275) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Aug 24 03:10:34.216351 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-16139166', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-3484247'] for segment, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: Traceback (most recent call last): Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: timer() Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: cb(*args, **kw) Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: return func(*args, **kwargs) Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: self._notify() Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: self.callback(batched_events) Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: event.method(event) Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_id = self._get_aggregate_id(event.segment_id) Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: aggregate_uuid = self.p_client.list_aggregates( Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: return f(self, *a, **k) Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._get(url).json() Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: return self._client.get(url, endpoint_filter=self._ks_filter, Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: return self.request(url, 'GET', **kwargs) Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: base_url = self.get_endpoint(auth, allow=allow, Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: auth = self._auth_required(auth, 'determine endpoint URL') Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Aug 24 03:10:34.218010 dv-cinder-803748-8-iscsi neutron-server[111275]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Aug 24 03:10:34.242445 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.db.l3_dvrscheduler_db [None req-957c2ac4-89d1-4578-bfb0-ea5908f84472 None None] No DVR routers for this DVR port a2847c01-6cbd-41f7-a408-51b5059780df on host dv-cinder-803748-8-iscsi {{(pid=111277) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Aug 24 03:10:34.244374 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-957c2ac4-89d1-4578-bfb0-ea5908f84472 None None] Pushing event deleted for resources: {'Port': ['ID=a2847c01-6cbd-41f7-a408-51b5059780df,revision_number=None']} {{(pid=111277) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:34.324548 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-16200283', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-603127', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-748228', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-569395'] for network, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.329831 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-748250'] for network, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.331667 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] 10.222.0.30 "DELETE /v2.0/networks/0ea0c802-0090-450d-babb-4d8c5dbdbc8f HTTP/1.1" status: 204 len: 168 time: 0.6166515 Aug 24 03:10:34.342648 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8605b47-adc2-4b75-8a8f-be4439f84517 admin admin] Pushing event deleted for resources: {'Network': ['ID=0ea0c802-0090-450d-babb-4d8c5dbdbc8f,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:34.697536 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42426) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:34.736601 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-0c9e3417-2ef6-4fd1-8edf-78bebbe39c8a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a74f1fd1896c4ed09ff280398fa2440f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0378799 Aug 24 03:10:34.738976 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42428) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:34.784942 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff8d5540-d508-402e-807b-1b4455e5d169 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.805652 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff8d5540-d508-402e-807b-1b4455e5d169 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.907457 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff8d5540-d508-402e-807b-1b4455e5d169 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.909957 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-ff8d5540-d508-402e-807b-1b4455e5d169 admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:34.911113 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-ff8d5540-d508-402e-807b-1b4455e5d169 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/9abe615f-f88c-4d6c-97fa-2384752d2c4b HTTP/1.1" status: 204 len: 168 time: 0.1712706 Aug 24 03:10:34.918785 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff8d5540-d508-402e-807b-1b4455e5d169 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9abe615f-f88c-4d6c-97fa-2384752d2c4b,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:35.232527 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device a2847c01-6cbd-41f7-a408-51b5059780df no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:35.252467 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: a2847c01-6cbd-41f7-a408-51b5059780df {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:35.252816 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device a2847c01-6cbd-41f7-a408-51b5059780df not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:35.253230 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 35e488a7-bf51-48e0-a230-0481006d2fbb no longer exists at agent ovs-agent-dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Aug 24 03:10:35.274297 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.plugin [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] No Port match for: 35e488a7-bf51-48e0-a230-0481006d2fbb {{(pid=111277) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2253}} Aug 24 03:10:35.274658 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron.plugins.ml2.rpc [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Device 35e488a7-bf51-48e0-a230-0481006d2fbb not bound to the agent host dv-cinder-803748-8-iscsi {{(pid=111277) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Aug 24 03:10:35.571293 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42434) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:35.609369 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-0e0a421c-1087-4fc2-97c1-0b987c183c27 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=849103eb110a4cd69c63067564c4696e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0368583 Aug 24 03:10:35.611652 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.wsgi [-] (111275) accepted ('10.222.0.30', 42436) {{(pid=111275) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Aug 24 03:10:35.658788 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-938d1b06-2ac8-440f-b1ad-f0bbc36c9e6f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:35.679094 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-938d1b06-2ac8-440f-b1ad-f0bbc36c9e6f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:35.810237 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-938d1b06-2ac8-440f-b1ad-f0bbc36c9e6f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-602971'] for security_group, after_delete {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:35.813950 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron_lib.callbacks.manager [None req-938d1b06-2ac8-440f-b1ad-f0bbc36c9e6f admin admin] Notify callbacks [] for security_group, before_response {{(pid=111275) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:35.815073 dv-cinder-803748-8-iscsi neutron-server[111275]: INFO neutron.wsgi [None req-938d1b06-2ac8-440f-b1ad-f0bbc36c9e6f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2208264b-4895-45b2-9784-cfb20a1e69f3 HTTP/1.1" status: 204 len: 168 time: 0.2025568 Aug 24 03:10:35.822690 dv-cinder-803748-8-iscsi neutron-server[111275]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-938d1b06-2ac8-440f-b1ad-f0bbc36c9e6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2208264b-4895-45b2-9784-cfb20a1e69f3,revision_number=None']} {{(pid=111275) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Aug 24 03:10:38.632306 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:48.565762 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:10:51.409930 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-0d355ee2-667e-46fe-8339-a2d7a3a65803 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:53.992566 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-e1130a90-9889-462e-8c80-b6371dfe49f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:54.376329 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:55.610197 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:10:56.992189 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:11:08.649006 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:11:21.385797 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-048eaeb4-01d5-47f3-a2b4-652bbd98ee59 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:11:23.945382 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-85bbf7ec-ddcf-43a8-8cdf-17ccbdd9c35d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:11:24.328539 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:11:25.564740 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:11:25.596991 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:11:26.969421 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:11:38.665066 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:11:51.373400 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-34f4115d-3ceb-4f08-a46e-cf5ed3a8c914 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:11:53.984975 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9edf3e7e-7f4a-402d-908d-32c574eaae64 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:11:54.333380 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:11:55.607634 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:11:56.984545 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:12:02.563807 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:12:08.636226 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:12:21.418508 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-e6f84a65-b65c-499e-8bb0-5bfbebc40c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:12:23.954514 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-79c3dea8-290d-4804-9d21-f54c1463393a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:12:24.349973 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:12:25.659080 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:12:27.029942 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:12:38.641452 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:12:39.566210 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:12:51.389356 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-73db248f-b86a-4da5-b13f-17edad0879d2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:12:53.983656 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-9d764b10-47d0-4eaa-b3b2-e3fd6711a91e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:12:54.338068 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:12:55.646864 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:12:57.004732 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:13:08.661756 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:13:16.565460 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:13:21.421093 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4cf0da8e-4ab7-447e-ad92-95929f4fec24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:13:23.966008 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-3f71cc11-3704-41d5-ae82-261849854fa1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:13:24.343245 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:13:25.638438 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:13:26.988454 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:13:38.689517 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:13:51.374031 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-d5aab947-9612-4417-ae51-18104f66a3ab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:13:53.578170 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:13:53.973989 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-e6c9be4c-5e5c-4f57-9382-17be6bb31db7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:13:54.370724 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:13:55.642783 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:13:57.021957 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:14:08.681913 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:14:21.392831 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-beb08fef-61b6-418d-b18e-b300edb107cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:14:23.970436 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-58c7b14a-c881-4a4b-b87b-28916be0ef61 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:14:24.341423 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:14:25.636097 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:14:27.016200 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:14:30.562986 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:14:38.656071 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:14:51.400445 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-103e486e-186c-448a-b9d4-e09a75e78289 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:14:53.982846 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-ee83b20b-248d-4341-a8ac-8ed10b80a910 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:14:54.340792 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:14:55.599793 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:14:57.044031 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:15:07.561823 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Aug 24 03:15:08.696569 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:15:21.376059 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-6edf5282-f5af-4665-8eb5-c8d5416484aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:15:23.981554 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-307e8126-1996-4faa-b91c-85556f63d080 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:15:24.371053 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-4ed943a6-e40e-4ef8-ac82-4954e390db04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:15:25.627787 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-09a5700d-c575-48f9-96e0-6d15c2d7551d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:15:27.021747 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-eea1094b-8678-4300-bacd-c1b626e18792 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:15:38.655581 dv-cinder-803748-8-iscsi neutron-server[111277]: DEBUG neutron_lib.callbacks.manager [None req-5b839489-a5a2-4321-b44d-0e7faefa353c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732364285480', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-16201496'] for agent, after_update {{(pid=111277) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Aug 24 03:15:44.561544 dv-cinder-803748-8-iscsi neutron-server[111278]: DEBUG neutron.db.agents_db [None req-c0f772ac-d960-4fa4-8cab-1bc0502b14a7 None None] Agent healthcheck: found 6 active agents {{(pid=111278) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}